2023-02-16 18:01:00,177 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-16 18:01:00,221 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=242, MaxFileDescriptor=60000, SystemLoadAverage=145, ProcessCount=168, AvailableMemoryMB=3634 2023-02-16 18:01:00,495 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9c71488a-f642-9649-d836-a74163cd870e 2023-02-16 18:01:00,502 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-16 18:01:00,503 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9c71488a-f642-9649-d836-a74163cd870e/cluster_e516932b-80c4-8478-eabc-743e1d98ecd3, deleteOnExit=true 2023-02-16 18:01:00,503 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-16 18:01:00,503 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9c71488a-f642-9649-d836-a74163cd870e/test.cache.data in system properties and HBase conf 2023-02-16 18:01:00,504 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9c71488a-f642-9649-d836-a74163cd870e/hadoop.tmp.dir in system properties and HBase conf 2023-02-16 18:01:00,504 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9c71488a-f642-9649-d836-a74163cd870e/hadoop.log.dir in system properties and HBase conf 2023-02-16 18:01:00,505 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9c71488a-f642-9649-d836-a74163cd870e/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-16 18:01:00,505 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9c71488a-f642-9649-d836-a74163cd870e/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-16 18:01:00,505 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-16 18:01:00,595 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-16 18:01:00,952 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-16 18:01:00,956 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9c71488a-f642-9649-d836-a74163cd870e/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-16 18:01:00,956 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9c71488a-f642-9649-d836-a74163cd870e/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-16 18:01:00,957 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9c71488a-f642-9649-d836-a74163cd870e/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-16 18:01:00,957 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9c71488a-f642-9649-d836-a74163cd870e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 18:01:00,957 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9c71488a-f642-9649-d836-a74163cd870e/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-16 18:01:00,958 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9c71488a-f642-9649-d836-a74163cd870e/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-16 18:01:00,958 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9c71488a-f642-9649-d836-a74163cd870e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 18:01:00,958 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9c71488a-f642-9649-d836-a74163cd870e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 18:01:00,958 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9c71488a-f642-9649-d836-a74163cd870e/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-16 18:01:00,959 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9c71488a-f642-9649-d836-a74163cd870e/nfs.dump.dir in system properties and HBase conf 2023-02-16 18:01:00,959 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9c71488a-f642-9649-d836-a74163cd870e/java.io.tmpdir in system properties and HBase conf 2023-02-16 18:01:00,959 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9c71488a-f642-9649-d836-a74163cd870e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 18:01:00,959 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9c71488a-f642-9649-d836-a74163cd870e/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-16 18:01:00,960 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9c71488a-f642-9649-d836-a74163cd870e/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-16 18:01:01,400 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 18:01:01,404 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 18:01:01,661 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-16 18:01:01,819 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-16 18:01:01,833 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 18:01:01,870 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 18:01:01,906 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9c71488a-f642-9649-d836-a74163cd870e/java.io.tmpdir/Jetty_localhost_36931_hdfs____.vsqnuq/webapp 2023-02-16 18:01:02,046 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36931 2023-02-16 18:01:02,058 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 18:01:02,058 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 18:01:02,586 WARN [Listener at localhost/43129] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 18:01:02,666 WARN [Listener at localhost/43129] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 18:01:02,689 WARN [Listener at localhost/43129] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 18:01:02,696 INFO [Listener at localhost/43129] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 18:01:02,703 INFO [Listener at localhost/43129] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9c71488a-f642-9649-d836-a74163cd870e/java.io.tmpdir/Jetty_localhost_41261_datanode____.ghbux/webapp 2023-02-16 18:01:02,813 INFO [Listener at localhost/43129] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41261 2023-02-16 18:01:03,236 WARN [Listener at localhost/41245] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 18:01:03,253 WARN [Listener at localhost/41245] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 18:01:03,260 WARN [Listener at localhost/41245] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 18:01:03,262 INFO [Listener at localhost/41245] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 18:01:03,268 INFO [Listener at localhost/41245] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9c71488a-f642-9649-d836-a74163cd870e/java.io.tmpdir/Jetty_localhost_40051_datanode____.xin2h5/webapp 2023-02-16 18:01:03,404 INFO [Listener at localhost/41245] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40051 2023-02-16 18:01:03,418 WARN [Listener at localhost/45407] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 18:01:03,717 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbaa472ad48013027: Processing first storage report for DS-b2813352-329f-45d8-8445-165d0554ce1a from datanode 428e4d18-92a4-4153-b2ab-b35fd0af60f4 2023-02-16 18:01:03,718 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbaa472ad48013027: from storage DS-b2813352-329f-45d8-8445-165d0554ce1a node DatanodeRegistration(127.0.0.1:46117, datanodeUuid=428e4d18-92a4-4153-b2ab-b35fd0af60f4, infoPort=34219, infoSecurePort=0, ipcPort=41245, storageInfo=lv=-57;cid=testClusterID;nsid=209007989;c=1676570461472), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-16 18:01:03,719 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcd6a51d92824eb50: Processing first storage report for DS-1fcd4080-d622-48d7-bc44-ca6aa303cb75 from datanode 9e43cf49-f612-45ae-b3de-ab03ad62222f 2023-02-16 18:01:03,719 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcd6a51d92824eb50: from storage DS-1fcd4080-d622-48d7-bc44-ca6aa303cb75 node DatanodeRegistration(127.0.0.1:37135, datanodeUuid=9e43cf49-f612-45ae-b3de-ab03ad62222f, infoPort=36579, infoSecurePort=0, ipcPort=45407, storageInfo=lv=-57;cid=testClusterID;nsid=209007989;c=1676570461472), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-16 18:01:03,719 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbaa472ad48013027: Processing first storage report for DS-ce3a5b1e-7cdd-4211-85e3-9aabed5a4e86 from datanode 428e4d18-92a4-4153-b2ab-b35fd0af60f4 2023-02-16 18:01:03,719 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbaa472ad48013027: from storage DS-ce3a5b1e-7cdd-4211-85e3-9aabed5a4e86 node DatanodeRegistration(127.0.0.1:46117, datanodeUuid=428e4d18-92a4-4153-b2ab-b35fd0af60f4, infoPort=34219, infoSecurePort=0, ipcPort=41245, storageInfo=lv=-57;cid=testClusterID;nsid=209007989;c=1676570461472), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 18:01:03,719 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcd6a51d92824eb50: Processing first storage report for DS-fd5d921e-772e-43d1-b2b2-74dfcabe8d1a from datanode 9e43cf49-f612-45ae-b3de-ab03ad62222f 2023-02-16 18:01:03,719 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcd6a51d92824eb50: from storage DS-fd5d921e-772e-43d1-b2b2-74dfcabe8d1a node DatanodeRegistration(127.0.0.1:37135, datanodeUuid=9e43cf49-f612-45ae-b3de-ab03ad62222f, infoPort=36579, infoSecurePort=0, ipcPort=45407, storageInfo=lv=-57;cid=testClusterID;nsid=209007989;c=1676570461472), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 18:01:03,804 DEBUG [Listener at localhost/45407] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9c71488a-f642-9649-d836-a74163cd870e 2023-02-16 18:01:03,906 INFO [Listener at localhost/45407] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9c71488a-f642-9649-d836-a74163cd870e/cluster_e516932b-80c4-8478-eabc-743e1d98ecd3/zookeeper_0, clientPort=59495, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9c71488a-f642-9649-d836-a74163cd870e/cluster_e516932b-80c4-8478-eabc-743e1d98ecd3/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9c71488a-f642-9649-d836-a74163cd870e/cluster_e516932b-80c4-8478-eabc-743e1d98ecd3/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-16 18:01:03,930 INFO [Listener at localhost/45407] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=59495 2023-02-16 18:01:03,948 INFO [Listener at localhost/45407] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:03,951 INFO [Listener at localhost/45407] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:04,618 INFO [Listener at localhost/45407] util.FSUtils(479): Created version file at hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93 with version=8 2023-02-16 18:01:04,618 INFO [Listener at localhost/45407] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:04,620 INFO [Listener at localhost/45407] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:04,622 INFO [Listener at localhost/45407] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/hbase-staging 2023-02-16 18:01:04,960 INFO [Listener at localhost/45407] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-16 18:01:05,407 INFO [Listener at localhost/45407] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 18:01:05,438 INFO [Listener at localhost/45407] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:05,439 INFO [Listener at localhost/45407] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:05,439 INFO [Listener at localhost/45407] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 18:01:05,439 INFO [Listener at localhost/45407] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:05,439 INFO [Listener at localhost/45407] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 18:01:05,576 INFO [Listener at localhost/45407] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 18:01:05,645 DEBUG [Listener at localhost/45407] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-16 18:01:05,736 INFO [Listener at localhost/45407] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43805 2023-02-16 18:01:05,746 INFO [Listener at localhost/45407] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:05,748 INFO [Listener at localhost/45407] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:05,772 INFO [Listener at localhost/45407] zookeeper.RecoverableZooKeeper(93): Process identifier=master:43805 connecting to ZooKeeper ensemble=127.0.0.1:59495 2023-02-16 18:01:05,817 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:438050x0, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 18:01:05,820 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:43805-0x1005e4af84e0000 connected 2023-02-16 18:01:05,851 DEBUG [Listener at localhost/45407] zookeeper.ZKUtil(164): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 18:01:05,852 DEBUG [Listener at localhost/45407] zookeeper.ZKUtil(164): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:05,855 DEBUG [Listener at localhost/45407] zookeeper.ZKUtil(164): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 18:01:05,863 DEBUG [Listener at localhost/45407] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43805 2023-02-16 18:01:05,863 DEBUG [Listener at localhost/45407] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43805 2023-02-16 18:01:05,864 DEBUG [Listener at localhost/45407] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43805 2023-02-16 18:01:05,864 DEBUG [Listener at localhost/45407] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43805 2023-02-16 18:01:05,865 DEBUG [Listener at localhost/45407] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43805 2023-02-16 18:01:05,871 INFO [Listener at localhost/45407] master.HMaster(444): hbase.rootdir=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93, hbase.cluster.distributed=false 2023-02-16 18:01:05,940 INFO [Listener at localhost/45407] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 18:01:05,940 INFO [Listener at localhost/45407] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:05,941 INFO [Listener at localhost/45407] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:05,941 INFO [Listener at localhost/45407] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 18:01:05,941 INFO [Listener at localhost/45407] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:05,941 INFO [Listener at localhost/45407] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 18:01:05,946 INFO [Listener at localhost/45407] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 18:01:05,949 INFO [Listener at localhost/45407] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42055 2023-02-16 18:01:05,952 INFO [Listener at localhost/45407] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 18:01:05,959 DEBUG [Listener at localhost/45407] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:05,960 INFO [Listener at localhost/45407] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:05,963 INFO [Listener at localhost/45407] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:05,965 INFO [Listener at localhost/45407] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42055 connecting to ZooKeeper ensemble=127.0.0.1:59495 2023-02-16 18:01:05,969 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): regionserver:420550x0, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 18:01:05,970 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42055-0x1005e4af84e0001 connected 2023-02-16 18:01:05,970 DEBUG [Listener at localhost/45407] zookeeper.ZKUtil(164): regionserver:42055-0x1005e4af84e0001, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 18:01:05,971 DEBUG [Listener at localhost/45407] zookeeper.ZKUtil(164): regionserver:42055-0x1005e4af84e0001, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:05,972 DEBUG [Listener at localhost/45407] zookeeper.ZKUtil(164): regionserver:42055-0x1005e4af84e0001, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 18:01:05,973 DEBUG [Listener at localhost/45407] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42055 2023-02-16 18:01:05,973 DEBUG [Listener at localhost/45407] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42055 2023-02-16 18:01:05,974 DEBUG [Listener at localhost/45407] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42055 2023-02-16 18:01:05,976 DEBUG [Listener at localhost/45407] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42055 2023-02-16 18:01:05,976 DEBUG [Listener at localhost/45407] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42055 2023-02-16 18:01:05,989 INFO [Listener at localhost/45407] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 18:01:05,989 INFO [Listener at localhost/45407] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:05,990 INFO [Listener at localhost/45407] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:05,990 INFO [Listener at localhost/45407] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 18:01:05,991 INFO [Listener at localhost/45407] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:05,991 INFO [Listener at localhost/45407] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 18:01:05,991 INFO [Listener at localhost/45407] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 18:01:05,993 INFO [Listener at localhost/45407] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43537 2023-02-16 18:01:05,993 INFO [Listener at localhost/45407] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 18:01:05,997 DEBUG [Listener at localhost/45407] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:05,998 INFO [Listener at localhost/45407] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:06,000 INFO [Listener at localhost/45407] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:06,002 INFO [Listener at localhost/45407] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43537 connecting to ZooKeeper ensemble=127.0.0.1:59495 2023-02-16 18:01:06,006 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): regionserver:435370x0, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 18:01:06,007 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43537-0x1005e4af84e0002 connected 2023-02-16 18:01:06,007 DEBUG [Listener at localhost/45407] zookeeper.ZKUtil(164): regionserver:43537-0x1005e4af84e0002, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 18:01:06,008 DEBUG [Listener at localhost/45407] zookeeper.ZKUtil(164): regionserver:43537-0x1005e4af84e0002, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:06,008 DEBUG [Listener at localhost/45407] zookeeper.ZKUtil(164): regionserver:43537-0x1005e4af84e0002, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 18:01:06,009 DEBUG [Listener at localhost/45407] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43537 2023-02-16 18:01:06,010 DEBUG [Listener at localhost/45407] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43537 2023-02-16 18:01:06,011 DEBUG [Listener at localhost/45407] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43537 2023-02-16 18:01:06,012 DEBUG [Listener at localhost/45407] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43537 2023-02-16 18:01:06,016 DEBUG [Listener at localhost/45407] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43537 2023-02-16 18:01:06,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,43805,1676570464786 2023-02-16 18:01:06,027 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 18:01:06,028 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,43805,1676570464786 2023-02-16 18:01:06,048 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 18:01:06,048 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): regionserver:43537-0x1005e4af84e0002, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 18:01:06,048 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): regionserver:42055-0x1005e4af84e0001, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 18:01:06,048 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:06,050 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 18:01:06,051 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,43805,1676570464786 from backup master directory 2023-02-16 18:01:06,051 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 18:01:06,054 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,43805,1676570464786 2023-02-16 18:01:06,054 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 18:01:06,055 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 18:01:06,055 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,43805,1676570464786 2023-02-16 18:01:06,058 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-16 18:01:06,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-16 18:01:06,155 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/hbase.id with ID: 7f3944aa-5cbd-4ad6-9dd4-44ac433fc562 2023-02-16 18:01:06,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:06,212 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:06,263 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x32276ff2 to 127.0.0.1:59495 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 18:01:06,300 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7fd5ec0c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 18:01:06,324 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 18:01:06,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-16 18:01:06,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-16 18:01:06,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-16 18:01:06,346 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-02-16 18:01:06,350 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-02-16 18:01:06,351 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 18:01:06,392 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/MasterData/data/master/store-tmp 2023-02-16 18:01:06,424 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:06,424 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 18:01:06,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:06,424 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:06,425 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 18:01:06,425 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:06,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:06,425 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 18:01:06,426 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/MasterData/WALs/jenkins-hbase4.apache.org,43805,1676570464786 2023-02-16 18:01:06,448 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43805%2C1676570464786, suffix=, logDir=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/MasterData/WALs/jenkins-hbase4.apache.org,43805,1676570464786, archiveDir=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/MasterData/oldWALs, maxLogs=10 2023-02-16 18:01:06,506 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37135,DS-1fcd4080-d622-48d7-bc44-ca6aa303cb75,DISK] 2023-02-16 18:01:06,506 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46117,DS-b2813352-329f-45d8-8445-165d0554ce1a,DISK] 2023-02-16 18:01:06,514 DEBUG [RS-EventLoopGroup-4-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-16 18:01:06,582 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/MasterData/WALs/jenkins-hbase4.apache.org,43805,1676570464786/jenkins-hbase4.apache.org%2C43805%2C1676570464786.1676570466457 2023-02-16 18:01:06,582 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37135,DS-1fcd4080-d622-48d7-bc44-ca6aa303cb75,DISK], DatanodeInfoWithStorage[127.0.0.1:46117,DS-b2813352-329f-45d8-8445-165d0554ce1a,DISK]] 2023-02-16 18:01:06,583 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-16 18:01:06,583 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:06,587 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:06,588 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:06,663 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:06,672 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-16 18:01:06,712 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-16 18:01:06,728 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:06,735 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:06,737 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:06,757 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:06,764 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:06,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61338066, jitterRate=-0.08599159121513367}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 18:01:06,765 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 18:01:06,767 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-16 18:01:06,791 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-16 18:01:06,791 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-16 18:01:06,794 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-16 18:01:06,796 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-16 18:01:06,832 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 35 msec 2023-02-16 18:01:06,832 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-16 18:01:06,863 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-16 18:01:06,870 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-16 18:01:06,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-16 18:01:06,902 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-16 18:01:06,903 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-16 18:01:06,909 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-16 18:01:06,913 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-16 18:01:06,917 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:06,918 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-16 18:01:06,919 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-16 18:01:06,931 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-16 18:01:06,936 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): regionserver:42055-0x1005e4af84e0001, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:06,936 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:06,936 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): regionserver:43537-0x1005e4af84e0002, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:06,936 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:06,937 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,43805,1676570464786, sessionid=0x1005e4af84e0000, setting cluster-up flag (Was=false) 2023-02-16 18:01:06,958 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:06,964 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-16 18:01:06,966 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43805,1676570464786 2023-02-16 18:01:06,973 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:06,979 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-16 18:01:06,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43805,1676570464786 2023-02-16 18:01:06,984 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.hbase-snapshot/.tmp 2023-02-16 18:01:07,020 INFO [RS:1;jenkins-hbase4:43537] regionserver.HRegionServer(952): ClusterId : 7f3944aa-5cbd-4ad6-9dd4-44ac433fc562 2023-02-16 18:01:07,020 INFO [RS:0;jenkins-hbase4:42055] regionserver.HRegionServer(952): ClusterId : 7f3944aa-5cbd-4ad6-9dd4-44ac433fc562 2023-02-16 18:01:07,027 DEBUG [RS:0;jenkins-hbase4:42055] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 18:01:07,027 DEBUG [RS:1;jenkins-hbase4:43537] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 18:01:07,034 DEBUG [RS:0;jenkins-hbase4:42055] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 18:01:07,034 DEBUG [RS:1;jenkins-hbase4:43537] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 18:01:07,034 DEBUG [RS:0;jenkins-hbase4:42055] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 18:01:07,034 DEBUG [RS:1;jenkins-hbase4:43537] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 18:01:07,039 DEBUG [RS:1;jenkins-hbase4:43537] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 18:01:07,039 DEBUG [RS:0;jenkins-hbase4:42055] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 18:01:07,040 DEBUG [RS:0;jenkins-hbase4:42055] zookeeper.ReadOnlyZKClient(139): Connect 0x7cf3be3c to 127.0.0.1:59495 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 18:01:07,040 DEBUG [RS:1;jenkins-hbase4:43537] zookeeper.ReadOnlyZKClient(139): Connect 0x6303061c to 127.0.0.1:59495 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 18:01:07,048 DEBUG [RS:0;jenkins-hbase4:42055] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31014e1a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 18:01:07,049 DEBUG [RS:1;jenkins-hbase4:43537] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@fab2a53, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 18:01:07,049 DEBUG [RS:0;jenkins-hbase4:42055] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45f33c5e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 18:01:07,050 DEBUG [RS:1;jenkins-hbase4:43537] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5cefb319, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 18:01:07,082 DEBUG [RS:0;jenkins-hbase4:42055] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:42055 2023-02-16 18:01:07,082 DEBUG [RS:1;jenkins-hbase4:43537] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:43537 2023-02-16 18:01:07,087 INFO [RS:0;jenkins-hbase4:42055] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 18:01:07,087 INFO [RS:1;jenkins-hbase4:43537] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 18:01:07,088 INFO [RS:1;jenkins-hbase4:43537] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 18:01:07,088 INFO [RS:0;jenkins-hbase4:42055] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 18:01:07,088 DEBUG [RS:1;jenkins-hbase4:43537] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 18:01:07,088 DEBUG [RS:0;jenkins-hbase4:42055] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 18:01:07,091 INFO [RS:0;jenkins-hbase4:42055] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,43805,1676570464786 with isa=jenkins-hbase4.apache.org/172.31.14.131:42055, startcode=1676570465939 2023-02-16 18:01:07,091 INFO [RS:1;jenkins-hbase4:43537] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,43805,1676570464786 with isa=jenkins-hbase4.apache.org/172.31.14.131:43537, startcode=1676570465988 2023-02-16 18:01:07,116 DEBUG [RS:1;jenkins-hbase4:43537] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 18:01:07,116 DEBUG [RS:0;jenkins-hbase4:42055] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 18:01:07,160 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-16 18:01:07,170 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 18:01:07,170 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 18:01:07,170 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 18:01:07,170 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 18:01:07,170 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-16 18:01:07,171 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:07,171 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 18:01:07,171 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:07,172 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40747, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 18:01:07,172 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32985, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 18:01:07,173 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676570497173 2023-02-16 18:01:07,176 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-16 18:01:07,180 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 18:01:07,181 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-16 18:01:07,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:577) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-16 18:01:07,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43805] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:577) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-16 18:01:07,186 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 18:01:07,188 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-16 18:01:07,194 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-16 18:01:07,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-16 18:01:07,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-16 18:01:07,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-16 18:01:07,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:07,197 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-16 18:01:07,200 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-16 18:01:07,200 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-16 18:01:07,202 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-16 18:01:07,203 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-16 18:01:07,204 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676570467204,5,FailOnTimeoutGroup] 2023-02-16 18:01:07,208 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676570467205,5,FailOnTimeoutGroup] 2023-02-16 18:01:07,208 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:07,208 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-16 18:01:07,209 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:07,209 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:07,213 DEBUG [RS:1;jenkins-hbase4:43537] regionserver.HRegionServer(2829): Master is not running yet 2023-02-16 18:01:07,213 DEBUG [RS:0;jenkins-hbase4:42055] regionserver.HRegionServer(2829): Master is not running yet 2023-02-16 18:01:07,213 WARN [RS:1;jenkins-hbase4:43537] regionserver.HRegionServer(1031): reportForDuty failed; sleeping 1000 ms and then retrying. 2023-02-16 18:01:07,213 WARN [RS:0;jenkins-hbase4:42055] regionserver.HRegionServer(1031): reportForDuty failed; sleeping 1000 ms and then retrying. 2023-02-16 18:01:07,231 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 18:01:07,233 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 18:01:07,233 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93 2023-02-16 18:01:07,250 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:07,253 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 18:01:07,256 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/hbase/meta/1588230740/info 2023-02-16 18:01:07,257 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 18:01:07,259 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:07,259 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 18:01:07,262 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/hbase/meta/1588230740/rep_barrier 2023-02-16 18:01:07,262 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 18:01:07,263 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:07,263 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 18:01:07,265 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/hbase/meta/1588230740/table 2023-02-16 18:01:07,266 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 18:01:07,267 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:07,268 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/hbase/meta/1588230740 2023-02-16 18:01:07,269 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/hbase/meta/1588230740 2023-02-16 18:01:07,273 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 18:01:07,275 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 18:01:07,278 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:07,279 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75172398, jitterRate=0.12015601992607117}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 18:01:07,279 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 18:01:07,279 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 18:01:07,279 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 18:01:07,279 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 18:01:07,279 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 18:01:07,279 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 18:01:07,280 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 18:01:07,281 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 18:01:07,285 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 18:01:07,285 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-16 18:01:07,294 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-16 18:01:07,305 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-16 18:01:07,308 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-16 18:01:07,458 WARN [jenkins-hbase4:43805] assignment.AssignmentManager(2157): No servers available; cannot place 1 unassigned regions. 2023-02-16 18:01:08,215 INFO [RS:1;jenkins-hbase4:43537] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,43805,1676570464786 with isa=jenkins-hbase4.apache.org/172.31.14.131:43537, startcode=1676570465988 2023-02-16 18:01:08,215 INFO [RS:0;jenkins-hbase4:42055] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,43805,1676570464786 with isa=jenkins-hbase4.apache.org/172.31.14.131:42055, startcode=1676570465939 2023-02-16 18:01:08,221 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43805] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:08,221 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:08,228 DEBUG [RS:0;jenkins-hbase4:42055] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93 2023-02-16 18:01:08,228 DEBUG [RS:1;jenkins-hbase4:43537] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93 2023-02-16 18:01:08,228 DEBUG [RS:0;jenkins-hbase4:42055] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:43129 2023-02-16 18:01:08,228 DEBUG [RS:1;jenkins-hbase4:43537] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:43129 2023-02-16 18:01:08,228 DEBUG [RS:0;jenkins-hbase4:42055] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 18:01:08,228 DEBUG [RS:1;jenkins-hbase4:43537] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 18:01:08,239 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:08,240 DEBUG [RS:1;jenkins-hbase4:43537] zookeeper.ZKUtil(162): regionserver:43537-0x1005e4af84e0002, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:08,240 DEBUG [RS:0;jenkins-hbase4:42055] zookeeper.ZKUtil(162): regionserver:42055-0x1005e4af84e0001, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:08,240 WARN [RS:1;jenkins-hbase4:43537] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 18:01:08,240 WARN [RS:0;jenkins-hbase4:42055] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 18:01:08,241 INFO [RS:1;jenkins-hbase4:43537] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 18:01:08,241 INFO [RS:0;jenkins-hbase4:42055] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 18:01:08,241 DEBUG [RS:1;jenkins-hbase4:43537] regionserver.HRegionServer(1947): logDir=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/WALs/jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:08,241 DEBUG [RS:0;jenkins-hbase4:42055] regionserver.HRegionServer(1947): logDir=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/WALs/jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:08,242 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42055,1676570465939] 2023-02-16 18:01:08,242 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43537,1676570465988] 2023-02-16 18:01:08,252 DEBUG [RS:1;jenkins-hbase4:43537] zookeeper.ZKUtil(162): regionserver:43537-0x1005e4af84e0002, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:08,252 DEBUG [RS:0;jenkins-hbase4:42055] zookeeper.ZKUtil(162): regionserver:42055-0x1005e4af84e0001, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:08,255 DEBUG [RS:0;jenkins-hbase4:42055] zookeeper.ZKUtil(162): regionserver:42055-0x1005e4af84e0001, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:08,255 DEBUG [RS:1;jenkins-hbase4:43537] zookeeper.ZKUtil(162): regionserver:43537-0x1005e4af84e0002, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:08,267 DEBUG [RS:0;jenkins-hbase4:42055] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 18:01:08,267 DEBUG [RS:1;jenkins-hbase4:43537] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 18:01:08,277 INFO [RS:0;jenkins-hbase4:42055] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 18:01:08,277 INFO [RS:1;jenkins-hbase4:43537] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 18:01:08,298 INFO [RS:0;jenkins-hbase4:42055] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 18:01:08,298 INFO [RS:1;jenkins-hbase4:43537] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 18:01:08,303 INFO [RS:0;jenkins-hbase4:42055] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 18:01:08,303 INFO [RS:1;jenkins-hbase4:43537] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 18:01:08,304 INFO [RS:0;jenkins-hbase4:42055] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:08,304 INFO [RS:1;jenkins-hbase4:43537] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:08,305 INFO [RS:0;jenkins-hbase4:42055] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 18:01:08,305 INFO [RS:1;jenkins-hbase4:43537] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 18:01:08,314 INFO [RS:0;jenkins-hbase4:42055] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:08,314 INFO [RS:1;jenkins-hbase4:43537] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:08,314 DEBUG [RS:0;jenkins-hbase4:42055] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:08,315 DEBUG [RS:0;jenkins-hbase4:42055] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:08,315 DEBUG [RS:1;jenkins-hbase4:43537] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:08,315 DEBUG [RS:0;jenkins-hbase4:42055] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:08,315 DEBUG [RS:1;jenkins-hbase4:43537] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:08,315 DEBUG [RS:0;jenkins-hbase4:42055] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:08,315 DEBUG [RS:1;jenkins-hbase4:43537] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:08,315 DEBUG [RS:0;jenkins-hbase4:42055] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:08,316 DEBUG [RS:1;jenkins-hbase4:43537] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:08,316 DEBUG [RS:0;jenkins-hbase4:42055] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 18:01:08,316 DEBUG [RS:1;jenkins-hbase4:43537] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:08,316 DEBUG [RS:0;jenkins-hbase4:42055] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:08,316 DEBUG [RS:1;jenkins-hbase4:43537] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 18:01:08,316 DEBUG [RS:0;jenkins-hbase4:42055] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:08,316 DEBUG [RS:1;jenkins-hbase4:43537] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:08,316 DEBUG [RS:0;jenkins-hbase4:42055] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:08,316 DEBUG [RS:1;jenkins-hbase4:43537] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:08,316 DEBUG [RS:0;jenkins-hbase4:42055] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:08,316 DEBUG [RS:1;jenkins-hbase4:43537] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:08,317 DEBUG [RS:1;jenkins-hbase4:43537] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:08,324 INFO [RS:0;jenkins-hbase4:42055] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:08,324 INFO [RS:0;jenkins-hbase4:42055] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:08,324 INFO [RS:1;jenkins-hbase4:43537] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:08,324 INFO [RS:0;jenkins-hbase4:42055] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:08,324 INFO [RS:1;jenkins-hbase4:43537] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:08,325 INFO [RS:1;jenkins-hbase4:43537] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:08,343 INFO [RS:0;jenkins-hbase4:42055] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 18:01:08,343 INFO [RS:1;jenkins-hbase4:43537] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 18:01:08,347 INFO [RS:0;jenkins-hbase4:42055] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42055,1676570465939-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:08,347 INFO [RS:1;jenkins-hbase4:43537] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43537,1676570465988-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:08,372 INFO [RS:0;jenkins-hbase4:42055] regionserver.Replication(203): jenkins-hbase4.apache.org,42055,1676570465939 started 2023-02-16 18:01:08,372 INFO [RS:0;jenkins-hbase4:42055] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,42055,1676570465939, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42055, sessionid=0x1005e4af84e0001 2023-02-16 18:01:08,372 INFO [RS:1;jenkins-hbase4:43537] regionserver.Replication(203): jenkins-hbase4.apache.org,43537,1676570465988 started 2023-02-16 18:01:08,373 INFO [RS:1;jenkins-hbase4:43537] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,43537,1676570465988, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43537, sessionid=0x1005e4af84e0002 2023-02-16 18:01:08,373 DEBUG [RS:0;jenkins-hbase4:42055] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 18:01:08,373 DEBUG [RS:1;jenkins-hbase4:43537] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 18:01:08,373 DEBUG [RS:0;jenkins-hbase4:42055] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:08,373 DEBUG [RS:1;jenkins-hbase4:43537] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:08,374 DEBUG [RS:0;jenkins-hbase4:42055] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42055,1676570465939' 2023-02-16 18:01:08,374 DEBUG [RS:1;jenkins-hbase4:43537] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43537,1676570465988' 2023-02-16 18:01:08,375 DEBUG [RS:1;jenkins-hbase4:43537] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:08,375 DEBUG [RS:0;jenkins-hbase4:42055] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:08,376 DEBUG [RS:0;jenkins-hbase4:42055] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:08,376 DEBUG [RS:1;jenkins-hbase4:43537] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:08,377 DEBUG [RS:1;jenkins-hbase4:43537] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 18:01:08,377 DEBUG [RS:0;jenkins-hbase4:42055] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 18:01:08,377 DEBUG [RS:1;jenkins-hbase4:43537] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 18:01:08,377 DEBUG [RS:0;jenkins-hbase4:42055] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 18:01:08,377 DEBUG [RS:1;jenkins-hbase4:43537] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:08,377 DEBUG [RS:0;jenkins-hbase4:42055] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:08,378 DEBUG [RS:0;jenkins-hbase4:42055] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42055,1676570465939' 2023-02-16 18:01:08,377 DEBUG [RS:1;jenkins-hbase4:43537] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43537,1676570465988' 2023-02-16 18:01:08,378 DEBUG [RS:1;jenkins-hbase4:43537] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:08,378 DEBUG [RS:0;jenkins-hbase4:42055] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:08,379 DEBUG [RS:0;jenkins-hbase4:42055] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:08,379 DEBUG [RS:1;jenkins-hbase4:43537] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:08,379 DEBUG [RS:0;jenkins-hbase4:42055] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 18:01:08,379 DEBUG [RS:1;jenkins-hbase4:43537] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 18:01:08,379 INFO [RS:0;jenkins-hbase4:42055] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 18:01:08,380 INFO [RS:1;jenkins-hbase4:43537] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 18:01:08,380 INFO [RS:0;jenkins-hbase4:42055] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 18:01:08,380 INFO [RS:1;jenkins-hbase4:43537] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 18:01:08,460 DEBUG [jenkins-hbase4:43805] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-16 18:01:08,466 DEBUG [jenkins-hbase4:43805] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 18:01:08,472 DEBUG [jenkins-hbase4:43805] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 18:01:08,472 DEBUG [jenkins-hbase4:43805] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 18:01:08,472 DEBUG [jenkins-hbase4:43805] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 18:01:08,474 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43537,1676570465988, state=OPENING 2023-02-16 18:01:08,482 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-16 18:01:08,484 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:08,485 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 18:01:08,488 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43537,1676570465988}] 2023-02-16 18:01:08,674 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:08,676 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 18:01:08,679 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60992, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 18:01:08,693 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-16 18:01:08,693 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 18:01:08,696 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43537%2C1676570465988.meta, suffix=.meta, logDir=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/WALs/jenkins-hbase4.apache.org,43537,1676570465988, archiveDir=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/oldWALs, maxLogs=32 2023-02-16 18:01:08,717 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46117,DS-b2813352-329f-45d8-8445-165d0554ce1a,DISK] 2023-02-16 18:01:08,718 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37135,DS-1fcd4080-d622-48d7-bc44-ca6aa303cb75,DISK] 2023-02-16 18:01:08,722 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/WALs/jenkins-hbase4.apache.org,43537,1676570465988/jenkins-hbase4.apache.org%2C43537%2C1676570465988.meta.1676570468700.meta 2023-02-16 18:01:08,723 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46117,DS-b2813352-329f-45d8-8445-165d0554ce1a,DISK], DatanodeInfoWithStorage[127.0.0.1:37135,DS-1fcd4080-d622-48d7-bc44-ca6aa303cb75,DISK]] 2023-02-16 18:01:08,723 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-16 18:01:08,725 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-16 18:01:08,741 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-16 18:01:08,746 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-16 18:01:08,752 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-16 18:01:08,752 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:08,752 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-16 18:01:08,752 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-16 18:01:08,755 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 18:01:08,757 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/hbase/meta/1588230740/info 2023-02-16 18:01:08,757 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/hbase/meta/1588230740/info 2023-02-16 18:01:08,758 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 18:01:08,759 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:08,759 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 18:01:08,761 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/hbase/meta/1588230740/rep_barrier 2023-02-16 18:01:08,761 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/hbase/meta/1588230740/rep_barrier 2023-02-16 18:01:08,762 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 18:01:08,762 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:08,763 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 18:01:08,764 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/hbase/meta/1588230740/table 2023-02-16 18:01:08,764 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/hbase/meta/1588230740/table 2023-02-16 18:01:08,764 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 18:01:08,765 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:08,767 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/hbase/meta/1588230740 2023-02-16 18:01:08,770 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/hbase/meta/1588230740 2023-02-16 18:01:08,774 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 18:01:08,777 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 18:01:08,778 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75242868, jitterRate=0.12120610475540161}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 18:01:08,778 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 18:01:08,788 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676570468666 2023-02-16 18:01:08,807 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-16 18:01:08,808 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-16 18:01:08,808 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43537,1676570465988, state=OPEN 2023-02-16 18:01:08,811 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-16 18:01:08,811 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 18:01:08,815 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-16 18:01:08,816 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43537,1676570465988 in 323 msec 2023-02-16 18:01:08,821 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-16 18:01:08,821 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 1.5230 sec 2023-02-16 18:01:08,826 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.7550 sec 2023-02-16 18:01:08,826 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676570468826, completionTime=-1 2023-02-16 18:01:08,826 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-16 18:01:08,826 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-16 18:01:08,893 DEBUG [hconnection-0x7c26c4a5-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 18:01:08,895 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60996, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 18:01:08,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-16 18:01:08,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676570528912 2023-02-16 18:01:08,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676570588912 2023-02-16 18:01:08,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 85 msec 2023-02-16 18:01:08,936 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43805,1676570464786-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:08,936 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43805,1676570464786-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:08,936 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43805,1676570464786-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:08,938 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:43805, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:08,939 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:08,945 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-16 18:01:08,954 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-16 18:01:08,956 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 18:01:08,965 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-16 18:01:08,968 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 18:01:08,970 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 18:01:08,992 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/hbase/namespace/8b1312fe059e27b3414b8b45528213c8 2023-02-16 18:01:08,994 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/hbase/namespace/8b1312fe059e27b3414b8b45528213c8 empty. 2023-02-16 18:01:08,995 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/hbase/namespace/8b1312fe059e27b3414b8b45528213c8 2023-02-16 18:01:08,996 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-16 18:01:09,023 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-16 18:01:09,026 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 8b1312fe059e27b3414b8b45528213c8, NAME => 'hbase:namespace,,1676570468955.8b1312fe059e27b3414b8b45528213c8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp 2023-02-16 18:01:09,043 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676570468955.8b1312fe059e27b3414b8b45528213c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:09,043 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 8b1312fe059e27b3414b8b45528213c8, disabling compactions & flushes 2023-02-16 18:01:09,043 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676570468955.8b1312fe059e27b3414b8b45528213c8. 2023-02-16 18:01:09,043 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676570468955.8b1312fe059e27b3414b8b45528213c8. 2023-02-16 18:01:09,043 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676570468955.8b1312fe059e27b3414b8b45528213c8. after waiting 0 ms 2023-02-16 18:01:09,043 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676570468955.8b1312fe059e27b3414b8b45528213c8. 2023-02-16 18:01:09,043 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676570468955.8b1312fe059e27b3414b8b45528213c8. 2023-02-16 18:01:09,043 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 8b1312fe059e27b3414b8b45528213c8: 2023-02-16 18:01:09,048 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 18:01:09,063 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676570468955.8b1312fe059e27b3414b8b45528213c8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676570469051"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570469051"}]},"ts":"1676570469051"} 2023-02-16 18:01:09,092 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 18:01:09,094 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 18:01:09,098 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676570469094"}]},"ts":"1676570469094"} 2023-02-16 18:01:09,103 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-16 18:01:09,106 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 18:01:09,108 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 18:01:09,108 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 18:01:09,108 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 18:01:09,110 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8b1312fe059e27b3414b8b45528213c8, ASSIGN}] 2023-02-16 18:01:09,113 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8b1312fe059e27b3414b8b45528213c8, ASSIGN 2023-02-16 18:01:09,115 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=8b1312fe059e27b3414b8b45528213c8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43537,1676570465988; forceNewPlan=false, retain=false 2023-02-16 18:01:09,267 INFO [jenkins-hbase4:43805] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 18:01:09,268 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8b1312fe059e27b3414b8b45528213c8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:09,268 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676570468955.8b1312fe059e27b3414b8b45528213c8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676570469268"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570469268"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570469268"}]},"ts":"1676570469268"} 2023-02-16 18:01:09,273 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 8b1312fe059e27b3414b8b45528213c8, server=jenkins-hbase4.apache.org,43537,1676570465988}] 2023-02-16 18:01:09,392 INFO [RS:0;jenkins-hbase4:42055] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42055%2C1676570465939, suffix=, logDir=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/WALs/jenkins-hbase4.apache.org,42055,1676570465939, archiveDir=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/oldWALs, maxLogs=32 2023-02-16 18:01:09,393 INFO [RS:1;jenkins-hbase4:43537] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43537%2C1676570465988, suffix=, logDir=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/WALs/jenkins-hbase4.apache.org,43537,1676570465988, archiveDir=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/oldWALs, maxLogs=32 2023-02-16 18:01:09,413 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37135,DS-1fcd4080-d622-48d7-bc44-ca6aa303cb75,DISK] 2023-02-16 18:01:09,413 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46117,DS-b2813352-329f-45d8-8445-165d0554ce1a,DISK] 2023-02-16 18:01:09,419 INFO [RS:0;jenkins-hbase4:42055] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/WALs/jenkins-hbase4.apache.org,42055,1676570465939/jenkins-hbase4.apache.org%2C42055%2C1676570465939.1676570469396 2023-02-16 18:01:09,420 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37135,DS-1fcd4080-d622-48d7-bc44-ca6aa303cb75,DISK] 2023-02-16 18:01:09,420 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46117,DS-b2813352-329f-45d8-8445-165d0554ce1a,DISK] 2023-02-16 18:01:09,421 DEBUG [RS:0;jenkins-hbase4:42055] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37135,DS-1fcd4080-d622-48d7-bc44-ca6aa303cb75,DISK], DatanodeInfoWithStorage[127.0.0.1:46117,DS-b2813352-329f-45d8-8445-165d0554ce1a,DISK]] 2023-02-16 18:01:09,430 INFO [RS:1;jenkins-hbase4:43537] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/WALs/jenkins-hbase4.apache.org,43537,1676570465988/jenkins-hbase4.apache.org%2C43537%2C1676570465988.1676570469396 2023-02-16 18:01:09,430 DEBUG [RS:1;jenkins-hbase4:43537] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37135,DS-1fcd4080-d622-48d7-bc44-ca6aa303cb75,DISK], DatanodeInfoWithStorage[127.0.0.1:46117,DS-b2813352-329f-45d8-8445-165d0554ce1a,DISK]] 2023-02-16 18:01:09,436 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676570468955.8b1312fe059e27b3414b8b45528213c8. 2023-02-16 18:01:09,437 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8b1312fe059e27b3414b8b45528213c8, NAME => 'hbase:namespace,,1676570468955.8b1312fe059e27b3414b8b45528213c8.', STARTKEY => '', ENDKEY => ''} 2023-02-16 18:01:09,438 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 8b1312fe059e27b3414b8b45528213c8 2023-02-16 18:01:09,438 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676570468955.8b1312fe059e27b3414b8b45528213c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:09,439 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8b1312fe059e27b3414b8b45528213c8 2023-02-16 18:01:09,439 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8b1312fe059e27b3414b8b45528213c8 2023-02-16 18:01:09,441 INFO [StoreOpener-8b1312fe059e27b3414b8b45528213c8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 8b1312fe059e27b3414b8b45528213c8 2023-02-16 18:01:09,443 DEBUG [StoreOpener-8b1312fe059e27b3414b8b45528213c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/hbase/namespace/8b1312fe059e27b3414b8b45528213c8/info 2023-02-16 18:01:09,443 DEBUG [StoreOpener-8b1312fe059e27b3414b8b45528213c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/hbase/namespace/8b1312fe059e27b3414b8b45528213c8/info 2023-02-16 18:01:09,444 INFO [StoreOpener-8b1312fe059e27b3414b8b45528213c8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8b1312fe059e27b3414b8b45528213c8 columnFamilyName info 2023-02-16 18:01:09,444 INFO [StoreOpener-8b1312fe059e27b3414b8b45528213c8-1] regionserver.HStore(310): Store=8b1312fe059e27b3414b8b45528213c8/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:09,447 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/hbase/namespace/8b1312fe059e27b3414b8b45528213c8 2023-02-16 18:01:09,448 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/hbase/namespace/8b1312fe059e27b3414b8b45528213c8 2023-02-16 18:01:09,453 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8b1312fe059e27b3414b8b45528213c8 2023-02-16 18:01:09,457 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/hbase/namespace/8b1312fe059e27b3414b8b45528213c8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:09,458 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8b1312fe059e27b3414b8b45528213c8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61882842, jitterRate=-0.07787379622459412}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 18:01:09,458 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8b1312fe059e27b3414b8b45528213c8: 2023-02-16 18:01:09,460 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676570468955.8b1312fe059e27b3414b8b45528213c8., pid=6, masterSystemTime=1676570469429 2023-02-16 18:01:09,466 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676570468955.8b1312fe059e27b3414b8b45528213c8. 2023-02-16 18:01:09,466 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676570468955.8b1312fe059e27b3414b8b45528213c8. 2023-02-16 18:01:09,467 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8b1312fe059e27b3414b8b45528213c8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:09,467 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676570468955.8b1312fe059e27b3414b8b45528213c8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676570469467"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676570469467"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676570469467"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676570469467"}]},"ts":"1676570469467"} 2023-02-16 18:01:09,475 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-16 18:01:09,475 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 8b1312fe059e27b3414b8b45528213c8, server=jenkins-hbase4.apache.org,43537,1676570465988 in 198 msec 2023-02-16 18:01:09,478 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-16 18:01:09,479 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=8b1312fe059e27b3414b8b45528213c8, ASSIGN in 365 msec 2023-02-16 18:01:09,480 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 18:01:09,480 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676570469480"}]},"ts":"1676570469480"} 2023-02-16 18:01:09,483 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-16 18:01:09,485 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 18:01:09,488 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 528 msec 2023-02-16 18:01:09,568 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-16 18:01:09,571 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-16 18:01:09,571 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:09,609 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-16 18:01:09,628 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 18:01:09,633 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 32 msec 2023-02-16 18:01:09,642 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-16 18:01:09,654 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 18:01:09,660 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-02-16 18:01:09,669 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-16 18:01:09,672 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-16 18:01:09,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.617sec 2023-02-16 18:01:09,675 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-16 18:01:09,676 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-16 18:01:09,676 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-16 18:01:09,677 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43805,1676570464786-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-16 18:01:09,679 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43805,1676570464786-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-16 18:01:09,687 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-16 18:01:09,729 DEBUG [Listener at localhost/45407] zookeeper.ReadOnlyZKClient(139): Connect 0x01e264eb to 127.0.0.1:59495 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 18:01:09,734 DEBUG [Listener at localhost/45407] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3961392f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 18:01:09,771 DEBUG [hconnection-0x4ddf350c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 18:01:09,783 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32768, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 18:01:09,796 INFO [Listener at localhost/45407] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,43805,1676570464786 2023-02-16 18:01:09,796 DEBUG [Listener at localhost/45407] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-16 18:01:09,808 DEBUG [Listener at localhost/45407] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-16 18:01:09,812 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32852, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-16 18:01:09,817 INFO [Listener at localhost/45407] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-16 18:01:09,823 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-16 18:01:09,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-16 18:01:09,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 78 connection: 172.31.14.131:32852 deadline: 1676570529822, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-16 18:01:09,825 INFO [Listener at localhost/45407] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-16 18:01:09,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 18:01:09,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-16 18:01:09,847 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 18:01:09,849 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 18:01:09,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-16 18:01:09,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 18:01:09,877 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/a846001b1c0ad7ee601f4b65dccb7fe6 2023-02-16 18:01:09,877 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470 2023-02-16 18:01:09,878 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798 2023-02-16 18:01:09,878 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85 2023-02-16 18:01:09,878 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470 empty. 2023-02-16 18:01:09,878 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6 2023-02-16 18:01:09,878 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/a846001b1c0ad7ee601f4b65dccb7fe6 empty. 2023-02-16 18:01:09,879 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5 2023-02-16 18:01:09,879 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1 2023-02-16 18:01:09,879 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169 2023-02-16 18:01:09,880 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798 empty. 2023-02-16 18:01:09,880 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470 2023-02-16 18:01:09,881 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad 2023-02-16 18:01:09,881 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85 empty. 2023-02-16 18:01:09,881 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6 empty. 2023-02-16 18:01:09,881 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/a846001b1c0ad7ee601f4b65dccb7fe6 2023-02-16 18:01:09,881 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5 empty. 2023-02-16 18:01:09,881 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/3dbbccccab831fa7f061de6d7982cb99 2023-02-16 18:01:09,882 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169 empty. 2023-02-16 18:01:09,882 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1 empty. 2023-02-16 18:01:09,883 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798 2023-02-16 18:01:09,883 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5 2023-02-16 18:01:09,883 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6 2023-02-16 18:01:09,883 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85 2023-02-16 18:01:09,883 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169 2023-02-16 18:01:09,883 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1 2023-02-16 18:01:09,883 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/3dbbccccab831fa7f061de6d7982cb99 empty. 2023-02-16 18:01:09,883 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad empty. 2023-02-16 18:01:09,884 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/3dbbccccab831fa7f061de6d7982cb99 2023-02-16 18:01:09,884 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad 2023-02-16 18:01:09,884 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-16 18:01:09,907 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-16 18:01:09,909 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => a846001b1c0ad7ee601f4b65dccb7fe6, NAME => 'testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp 2023-02-16 18:01:09,910 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 1ec804a87832ac193dda237561459798, NAME => 'testWithMapReduce,d\x84\x84,1676570469835.1ec804a87832ac193dda237561459798.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp 2023-02-16 18:01:09,912 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 1950baaa39bd11f61420d802e58dc470, NAME => 'testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp 2023-02-16 18:01:09,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:09,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing a846001b1c0ad7ee601f4b65dccb7fe6, disabling compactions & flushes 2023-02-16 18:01:09,965 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6. 2023-02-16 18:01:09,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6. 2023-02-16 18:01:09,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6. after waiting 0 ms 2023-02-16 18:01:09,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6. 2023-02-16 18:01:09,965 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6. 2023-02-16 18:01:09,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for a846001b1c0ad7ee601f4b65dccb7fe6: 2023-02-16 18:01:09,966 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0bcde8180cee91830f201cd407607b85, NAME => 'testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp 2023-02-16 18:01:09,966 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676570469835.1ec804a87832ac193dda237561459798.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:09,967 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 1ec804a87832ac193dda237561459798, disabling compactions & flushes 2023-02-16 18:01:09,967 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676570469835.1ec804a87832ac193dda237561459798. 2023-02-16 18:01:09,967 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676570469835.1ec804a87832ac193dda237561459798. 2023-02-16 18:01:09,967 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676570469835.1ec804a87832ac193dda237561459798. after waiting 0 ms 2023-02-16 18:01:09,967 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676570469835.1ec804a87832ac193dda237561459798. 2023-02-16 18:01:09,967 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676570469835.1ec804a87832ac193dda237561459798. 2023-02-16 18:01:09,967 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 1ec804a87832ac193dda237561459798: 2023-02-16 18:01:09,968 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 70d5f9a2baf8a4ffb3bc7c7c9109edc6, NAME => 'testWithMapReduce,j\xCA\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp 2023-02-16 18:01:09,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 18:01:09,987 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:09,988 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 0bcde8180cee91830f201cd407607b85, disabling compactions & flushes 2023-02-16 18:01:09,988 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85. 2023-02-16 18:01:09,988 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85. 2023-02-16 18:01:09,988 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85. after waiting 0 ms 2023-02-16 18:01:09,988 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85. 2023-02-16 18:01:09,989 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85. 2023-02-16 18:01:09,989 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 0bcde8180cee91830f201cd407607b85: 2023-02-16 18:01:09,990 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => f8eb7c082b6f65c6ec1c2a7d5837aec5, NAME => 'testWithMapReduce,m\xED\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp 2023-02-16 18:01:09,996 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:09,996 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 70d5f9a2baf8a4ffb3bc7c7c9109edc6, disabling compactions & flushes 2023-02-16 18:01:09,996 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6. 2023-02-16 18:01:09,996 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6. 2023-02-16 18:01:09,996 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6. after waiting 0 ms 2023-02-16 18:01:09,996 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6. 2023-02-16 18:01:09,996 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6. 2023-02-16 18:01:09,996 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 70d5f9a2baf8a4ffb3bc7c7c9109edc6: 2023-02-16 18:01:09,997 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 15cb379e20ca93b338be353101a05169, NAME => 'testWithMapReduce,q\x11\x10,1676570469835.15cb379e20ca93b338be353101a05169.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp 2023-02-16 18:01:10,016 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:10,017 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing f8eb7c082b6f65c6ec1c2a7d5837aec5, disabling compactions & flushes 2023-02-16 18:01:10,017 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5. 2023-02-16 18:01:10,017 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5. 2023-02-16 18:01:10,017 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5. after waiting 0 ms 2023-02-16 18:01:10,017 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5. 2023-02-16 18:01:10,017 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5. 2023-02-16 18:01:10,017 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for f8eb7c082b6f65c6ec1c2a7d5837aec5: 2023-02-16 18:01:10,018 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 9ec2815f78d2a1df813f1db89d7687e1, NAME => 'testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp 2023-02-16 18:01:10,018 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676570469835.15cb379e20ca93b338be353101a05169.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:10,019 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 15cb379e20ca93b338be353101a05169, disabling compactions & flushes 2023-02-16 18:01:10,019 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676570469835.15cb379e20ca93b338be353101a05169. 2023-02-16 18:01:10,019 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676570469835.15cb379e20ca93b338be353101a05169. 2023-02-16 18:01:10,019 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676570469835.15cb379e20ca93b338be353101a05169. after waiting 0 ms 2023-02-16 18:01:10,019 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676570469835.15cb379e20ca93b338be353101a05169. 2023-02-16 18:01:10,019 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676570469835.15cb379e20ca93b338be353101a05169. 2023-02-16 18:01:10,019 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 15cb379e20ca93b338be353101a05169: 2023-02-16 18:01:10,020 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 510c37f08338dbe42f94233e8f445fad, NAME => 'testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp 2023-02-16 18:01:10,077 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:10,077 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 510c37f08338dbe42f94233e8f445fad, disabling compactions & flushes 2023-02-16 18:01:10,077 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad. 2023-02-16 18:01:10,077 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad. 2023-02-16 18:01:10,077 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad. after waiting 0 ms 2023-02-16 18:01:10,078 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad. 2023-02-16 18:01:10,078 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad. 2023-02-16 18:01:10,078 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 510c37f08338dbe42f94233e8f445fad: 2023-02-16 18:01:10,078 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:10,080 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 3dbbccccab831fa7f061de6d7982cb99, NAME => 'testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp 2023-02-16 18:01:10,080 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 9ec2815f78d2a1df813f1db89d7687e1, disabling compactions & flushes 2023-02-16 18:01:10,080 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1. 2023-02-16 18:01:10,081 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1. 2023-02-16 18:01:10,081 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1. after waiting 0 ms 2023-02-16 18:01:10,081 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1. 2023-02-16 18:01:10,081 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1. 2023-02-16 18:01:10,081 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 9ec2815f78d2a1df813f1db89d7687e1: 2023-02-16 18:01:10,099 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:10,099 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 3dbbccccab831fa7f061de6d7982cb99, disabling compactions & flushes 2023-02-16 18:01:10,099 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99. 2023-02-16 18:01:10,099 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99. 2023-02-16 18:01:10,099 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99. after waiting 0 ms 2023-02-16 18:01:10,099 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99. 2023-02-16 18:01:10,099 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99. 2023-02-16 18:01:10,100 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 3dbbccccab831fa7f061de6d7982cb99: 2023-02-16 18:01:10,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 18:01:10,367 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:10,367 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 1950baaa39bd11f61420d802e58dc470, disabling compactions & flushes 2023-02-16 18:01:10,367 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470. 2023-02-16 18:01:10,367 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470. 2023-02-16 18:01:10,367 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470. after waiting 0 ms 2023-02-16 18:01:10,367 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470. 2023-02-16 18:01:10,367 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470. 2023-02-16 18:01:10,367 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 1950baaa39bd11f61420d802e58dc470: 2023-02-16 18:01:10,373 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 18:01:10,375 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676570470374"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570470374"}]},"ts":"1676570470374"} 2023-02-16 18:01:10,375 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676570469835.1ec804a87832ac193dda237561459798.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570470374"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570470374"}]},"ts":"1676570470374"} 2023-02-16 18:01:10,375 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676570469835.0bcde8180cee91830f201cd407607b85.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570470374"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570470374"}]},"ts":"1676570470374"} 2023-02-16 18:01:10,376 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570470374"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570470374"}]},"ts":"1676570470374"} 2023-02-16 18:01:10,376 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570470374"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570470374"}]},"ts":"1676570470374"} 2023-02-16 18:01:10,376 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676570469835.15cb379e20ca93b338be353101a05169.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570470374"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570470374"}]},"ts":"1676570470374"} 2023-02-16 18:01:10,376 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570470374"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570470374"}]},"ts":"1676570470374"} 2023-02-16 18:01:10,376 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570470374"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570470374"}]},"ts":"1676570470374"} 2023-02-16 18:01:10,376 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676570470374"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570470374"}]},"ts":"1676570470374"} 2023-02-16 18:01:10,377 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570470374"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570470374"}]},"ts":"1676570470374"} 2023-02-16 18:01:10,427 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-16 18:01:10,429 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 18:01:10,430 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676570470429"}]},"ts":"1676570470429"} 2023-02-16 18:01:10,432 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-16 18:01:10,437 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 18:01:10,449 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 18:01:10,450 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 18:01:10,450 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 18:01:10,450 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a846001b1c0ad7ee601f4b65dccb7fe6, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1950baaa39bd11f61420d802e58dc470, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1ec804a87832ac193dda237561459798, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0bcde8180cee91830f201cd407607b85, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=70d5f9a2baf8a4ffb3bc7c7c9109edc6, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f8eb7c082b6f65c6ec1c2a7d5837aec5, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=15cb379e20ca93b338be353101a05169, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9ec2815f78d2a1df813f1db89d7687e1, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=510c37f08338dbe42f94233e8f445fad, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3dbbccccab831fa7f061de6d7982cb99, ASSIGN}] 2023-02-16 18:01:10,457 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a846001b1c0ad7ee601f4b65dccb7fe6, ASSIGN 2023-02-16 18:01:10,457 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1950baaa39bd11f61420d802e58dc470, ASSIGN 2023-02-16 18:01:10,458 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1ec804a87832ac193dda237561459798, ASSIGN 2023-02-16 18:01:10,458 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0bcde8180cee91830f201cd407607b85, ASSIGN 2023-02-16 18:01:10,459 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=a846001b1c0ad7ee601f4b65dccb7fe6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43537,1676570465988; forceNewPlan=false, retain=false 2023-02-16 18:01:10,460 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=1950baaa39bd11f61420d802e58dc470, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42055,1676570465939; forceNewPlan=false, retain=false 2023-02-16 18:01:10,460 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=0bcde8180cee91830f201cd407607b85, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43537,1676570465988; forceNewPlan=false, retain=false 2023-02-16 18:01:10,460 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=1ec804a87832ac193dda237561459798, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42055,1676570465939; forceNewPlan=false, retain=false 2023-02-16 18:01:10,465 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3dbbccccab831fa7f061de6d7982cb99, ASSIGN 2023-02-16 18:01:10,466 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9ec2815f78d2a1df813f1db89d7687e1, ASSIGN 2023-02-16 18:01:10,466 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=510c37f08338dbe42f94233e8f445fad, ASSIGN 2023-02-16 18:01:10,466 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f8eb7c082b6f65c6ec1c2a7d5837aec5, ASSIGN 2023-02-16 18:01:10,466 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=15cb379e20ca93b338be353101a05169, ASSIGN 2023-02-16 18:01:10,467 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=3dbbccccab831fa7f061de6d7982cb99, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43537,1676570465988; forceNewPlan=false, retain=false 2023-02-16 18:01:10,467 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=9ec2815f78d2a1df813f1db89d7687e1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42055,1676570465939; forceNewPlan=false, retain=false 2023-02-16 18:01:10,468 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=510c37f08338dbe42f94233e8f445fad, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43537,1676570465988; forceNewPlan=false, retain=false 2023-02-16 18:01:10,468 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=f8eb7c082b6f65c6ec1c2a7d5837aec5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43537,1676570465988; forceNewPlan=false, retain=false 2023-02-16 18:01:10,468 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=15cb379e20ca93b338be353101a05169, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42055,1676570465939; forceNewPlan=false, retain=false 2023-02-16 18:01:10,469 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=70d5f9a2baf8a4ffb3bc7c7c9109edc6, ASSIGN 2023-02-16 18:01:10,470 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=70d5f9a2baf8a4ffb3bc7c7c9109edc6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42055,1676570465939; forceNewPlan=false, retain=false 2023-02-16 18:01:10,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 18:01:10,609 INFO [jenkins-hbase4:43805] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-16 18:01:10,613 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=f8eb7c082b6f65c6ec1c2a7d5837aec5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:10,613 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=a846001b1c0ad7ee601f4b65dccb7fe6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:10,613 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=510c37f08338dbe42f94233e8f445fad, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:10,613 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570470612"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570470612"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570470612"}]},"ts":"1676570470612"} 2023-02-16 18:01:10,613 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=3dbbccccab831fa7f061de6d7982cb99, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:10,613 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676570470613"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570470613"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570470613"}]},"ts":"1676570470613"} 2023-02-16 18:01:10,613 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570470613"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570470613"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570470613"}]},"ts":"1676570470613"} 2023-02-16 18:01:10,613 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=0bcde8180cee91830f201cd407607b85, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:10,613 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676570470612"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570470612"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570470612"}]},"ts":"1676570470612"} 2023-02-16 18:01:10,613 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676570469835.0bcde8180cee91830f201cd407607b85.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570470612"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570470612"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570470612"}]},"ts":"1676570470612"} 2023-02-16 18:01:10,618 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=16, state=RUNNABLE; OpenRegionProcedure f8eb7c082b6f65c6ec1c2a7d5837aec5, server=jenkins-hbase4.apache.org,43537,1676570465988}] 2023-02-16 18:01:10,621 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=11, state=RUNNABLE; OpenRegionProcedure a846001b1c0ad7ee601f4b65dccb7fe6, server=jenkins-hbase4.apache.org,43537,1676570465988}] 2023-02-16 18:01:10,622 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=19, state=RUNNABLE; OpenRegionProcedure 510c37f08338dbe42f94233e8f445fad, server=jenkins-hbase4.apache.org,43537,1676570465988}] 2023-02-16 18:01:10,624 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=20, state=RUNNABLE; OpenRegionProcedure 3dbbccccab831fa7f061de6d7982cb99, server=jenkins-hbase4.apache.org,43537,1676570465988}] 2023-02-16 18:01:10,625 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=14, state=RUNNABLE; OpenRegionProcedure 0bcde8180cee91830f201cd407607b85, server=jenkins-hbase4.apache.org,43537,1676570465988}] 2023-02-16 18:01:10,628 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=70d5f9a2baf8a4ffb3bc7c7c9109edc6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:10,628 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570470628"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570470628"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570470628"}]},"ts":"1676570470628"} 2023-02-16 18:01:10,629 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=1950baaa39bd11f61420d802e58dc470, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:10,629 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=9ec2815f78d2a1df813f1db89d7687e1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:10,629 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570470629"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570470629"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570470629"}]},"ts":"1676570470629"} 2023-02-16 18:01:10,629 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570470629"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570470629"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570470629"}]},"ts":"1676570470629"} 2023-02-16 18:01:10,633 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=15cb379e20ca93b338be353101a05169, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:10,633 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=1ec804a87832ac193dda237561459798, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:10,633 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676570469835.15cb379e20ca93b338be353101a05169.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570470633"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570470633"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570470633"}]},"ts":"1676570470633"} 2023-02-16 18:01:10,633 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676570469835.1ec804a87832ac193dda237561459798.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570470633"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570470633"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570470633"}]},"ts":"1676570470633"} 2023-02-16 18:01:10,634 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=15, state=RUNNABLE; OpenRegionProcedure 70d5f9a2baf8a4ffb3bc7c7c9109edc6, server=jenkins-hbase4.apache.org,42055,1676570465939}] 2023-02-16 18:01:10,634 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=12, state=RUNNABLE; OpenRegionProcedure 1950baaa39bd11f61420d802e58dc470, server=jenkins-hbase4.apache.org,42055,1676570465939}] 2023-02-16 18:01:10,635 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=18, state=RUNNABLE; OpenRegionProcedure 9ec2815f78d2a1df813f1db89d7687e1, server=jenkins-hbase4.apache.org,42055,1676570465939}] 2023-02-16 18:01:10,639 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=17, state=RUNNABLE; OpenRegionProcedure 15cb379e20ca93b338be353101a05169, server=jenkins-hbase4.apache.org,42055,1676570465939}] 2023-02-16 18:01:10,641 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=13, state=RUNNABLE; OpenRegionProcedure 1ec804a87832ac193dda237561459798, server=jenkins-hbase4.apache.org,42055,1676570465939}] 2023-02-16 18:01:10,781 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6. 2023-02-16 18:01:10,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a846001b1c0ad7ee601f4b65dccb7fe6, NAME => 'testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-16 18:01:10,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce a846001b1c0ad7ee601f4b65dccb7fe6 2023-02-16 18:01:10,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:10,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a846001b1c0ad7ee601f4b65dccb7fe6 2023-02-16 18:01:10,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a846001b1c0ad7ee601f4b65dccb7fe6 2023-02-16 18:01:10,785 INFO [StoreOpener-a846001b1c0ad7ee601f4b65dccb7fe6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a846001b1c0ad7ee601f4b65dccb7fe6 2023-02-16 18:01:10,788 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:10,788 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 18:01:10,794 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46924, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 18:01:10,797 DEBUG [StoreOpener-a846001b1c0ad7ee601f4b65dccb7fe6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/a846001b1c0ad7ee601f4b65dccb7fe6/f1 2023-02-16 18:01:10,797 DEBUG [StoreOpener-a846001b1c0ad7ee601f4b65dccb7fe6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/a846001b1c0ad7ee601f4b65dccb7fe6/f1 2023-02-16 18:01:10,798 INFO [StoreOpener-a846001b1c0ad7ee601f4b65dccb7fe6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a846001b1c0ad7ee601f4b65dccb7fe6 columnFamilyName f1 2023-02-16 18:01:10,799 INFO [StoreOpener-a846001b1c0ad7ee601f4b65dccb7fe6-1] regionserver.HStore(310): Store=a846001b1c0ad7ee601f4b65dccb7fe6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:10,799 INFO [StoreOpener-a846001b1c0ad7ee601f4b65dccb7fe6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a846001b1c0ad7ee601f4b65dccb7fe6 2023-02-16 18:01:10,800 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6. 2023-02-16 18:01:10,801 DEBUG [StoreOpener-a846001b1c0ad7ee601f4b65dccb7fe6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/a846001b1c0ad7ee601f4b65dccb7fe6/f2 2023-02-16 18:01:10,803 DEBUG [StoreOpener-a846001b1c0ad7ee601f4b65dccb7fe6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/a846001b1c0ad7ee601f4b65dccb7fe6/f2 2023-02-16 18:01:10,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 70d5f9a2baf8a4ffb3bc7c7c9109edc6, NAME => 'testWithMapReduce,j\xCA\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-16 18:01:10,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 70d5f9a2baf8a4ffb3bc7c7c9109edc6 2023-02-16 18:01:10,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:10,803 INFO [StoreOpener-a846001b1c0ad7ee601f4b65dccb7fe6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a846001b1c0ad7ee601f4b65dccb7fe6 columnFamilyName f2 2023-02-16 18:01:10,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 70d5f9a2baf8a4ffb3bc7c7c9109edc6 2023-02-16 18:01:10,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 70d5f9a2baf8a4ffb3bc7c7c9109edc6 2023-02-16 18:01:10,804 INFO [StoreOpener-a846001b1c0ad7ee601f4b65dccb7fe6-1] regionserver.HStore(310): Store=a846001b1c0ad7ee601f4b65dccb7fe6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:10,810 INFO [StoreOpener-70d5f9a2baf8a4ffb3bc7c7c9109edc6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 70d5f9a2baf8a4ffb3bc7c7c9109edc6 2023-02-16 18:01:10,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/a846001b1c0ad7ee601f4b65dccb7fe6 2023-02-16 18:01:10,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/a846001b1c0ad7ee601f4b65dccb7fe6 2023-02-16 18:01:10,812 DEBUG [StoreOpener-70d5f9a2baf8a4ffb3bc7c7c9109edc6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/f1 2023-02-16 18:01:10,813 DEBUG [StoreOpener-70d5f9a2baf8a4ffb3bc7c7c9109edc6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/f1 2023-02-16 18:01:10,813 INFO [StoreOpener-70d5f9a2baf8a4ffb3bc7c7c9109edc6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 70d5f9a2baf8a4ffb3bc7c7c9109edc6 columnFamilyName f1 2023-02-16 18:01:10,814 INFO [StoreOpener-70d5f9a2baf8a4ffb3bc7c7c9109edc6-1] regionserver.HStore(310): Store=70d5f9a2baf8a4ffb3bc7c7c9109edc6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:10,814 INFO [StoreOpener-70d5f9a2baf8a4ffb3bc7c7c9109edc6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 70d5f9a2baf8a4ffb3bc7c7c9109edc6 2023-02-16 18:01:10,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:10,817 DEBUG [StoreOpener-70d5f9a2baf8a4ffb3bc7c7c9109edc6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/f2 2023-02-16 18:01:10,817 DEBUG [StoreOpener-70d5f9a2baf8a4ffb3bc7c7c9109edc6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/f2 2023-02-16 18:01:10,818 INFO [StoreOpener-70d5f9a2baf8a4ffb3bc7c7c9109edc6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 70d5f9a2baf8a4ffb3bc7c7c9109edc6 columnFamilyName f2 2023-02-16 18:01:10,819 INFO [StoreOpener-70d5f9a2baf8a4ffb3bc7c7c9109edc6-1] regionserver.HStore(310): Store=70d5f9a2baf8a4ffb3bc7c7c9109edc6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:10,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6 2023-02-16 18:01:10,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6 2023-02-16 18:01:10,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a846001b1c0ad7ee601f4b65dccb7fe6 2023-02-16 18:01:10,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:10,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/a846001b1c0ad7ee601f4b65dccb7fe6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:10,829 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a846001b1c0ad7ee601f4b65dccb7fe6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71652776, jitterRate=0.06770956516265869}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:10,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a846001b1c0ad7ee601f4b65dccb7fe6: 2023-02-16 18:01:10,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 70d5f9a2baf8a4ffb3bc7c7c9109edc6 2023-02-16 18:01:10,831 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6., pid=22, masterSystemTime=1676570470774 2023-02-16 18:01:10,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6. 2023-02-16 18:01:10,833 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6. 2023-02-16 18:01:10,834 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5. 2023-02-16 18:01:10,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f8eb7c082b6f65c6ec1c2a7d5837aec5, NAME => 'testWithMapReduce,m\xED\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-16 18:01:10,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce f8eb7c082b6f65c6ec1c2a7d5837aec5 2023-02-16 18:01:10,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:10,834 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=a846001b1c0ad7ee601f4b65dccb7fe6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:10,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f8eb7c082b6f65c6ec1c2a7d5837aec5 2023-02-16 18:01:10,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f8eb7c082b6f65c6ec1c2a7d5837aec5 2023-02-16 18:01:10,835 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676570470834"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676570470834"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676570470834"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676570470834"}]},"ts":"1676570470834"} 2023-02-16 18:01:10,840 INFO [StoreOpener-f8eb7c082b6f65c6ec1c2a7d5837aec5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f8eb7c082b6f65c6ec1c2a7d5837aec5 2023-02-16 18:01:10,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:10,843 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 70d5f9a2baf8a4ffb3bc7c7c9109edc6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73995700, jitterRate=0.10262185335159302}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:10,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 70d5f9a2baf8a4ffb3bc7c7c9109edc6: 2023-02-16 18:01:10,844 DEBUG [StoreOpener-f8eb7c082b6f65c6ec1c2a7d5837aec5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/f1 2023-02-16 18:01:10,844 DEBUG [StoreOpener-f8eb7c082b6f65c6ec1c2a7d5837aec5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/f1 2023-02-16 18:01:10,844 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6., pid=26, masterSystemTime=1676570470788 2023-02-16 18:01:10,846 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=11 2023-02-16 18:01:10,846 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=11, state=SUCCESS; OpenRegionProcedure a846001b1c0ad7ee601f4b65dccb7fe6, server=jenkins-hbase4.apache.org,43537,1676570465988 in 219 msec 2023-02-16 18:01:10,846 INFO [StoreOpener-f8eb7c082b6f65c6ec1c2a7d5837aec5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8eb7c082b6f65c6ec1c2a7d5837aec5 columnFamilyName f1 2023-02-16 18:01:10,847 INFO [StoreOpener-f8eb7c082b6f65c6ec1c2a7d5837aec5-1] regionserver.HStore(310): Store=f8eb7c082b6f65c6ec1c2a7d5837aec5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:10,847 INFO [StoreOpener-f8eb7c082b6f65c6ec1c2a7d5837aec5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f8eb7c082b6f65c6ec1c2a7d5837aec5 2023-02-16 18:01:10,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6. 2023-02-16 18:01:10,849 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6. 2023-02-16 18:01:10,849 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470. 2023-02-16 18:01:10,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1950baaa39bd11f61420d802e58dc470, NAME => 'testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-16 18:01:10,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 1950baaa39bd11f61420d802e58dc470 2023-02-16 18:01:10,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:10,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1950baaa39bd11f61420d802e58dc470 2023-02-16 18:01:10,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1950baaa39bd11f61420d802e58dc470 2023-02-16 18:01:10,850 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a846001b1c0ad7ee601f4b65dccb7fe6, ASSIGN in 396 msec 2023-02-16 18:01:10,851 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=70d5f9a2baf8a4ffb3bc7c7c9109edc6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:10,851 DEBUG [StoreOpener-f8eb7c082b6f65c6ec1c2a7d5837aec5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/f2 2023-02-16 18:01:10,851 DEBUG [StoreOpener-f8eb7c082b6f65c6ec1c2a7d5837aec5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/f2 2023-02-16 18:01:10,851 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570470851"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676570470851"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676570470851"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676570470851"}]},"ts":"1676570470851"} 2023-02-16 18:01:10,852 INFO [StoreOpener-f8eb7c082b6f65c6ec1c2a7d5837aec5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8eb7c082b6f65c6ec1c2a7d5837aec5 columnFamilyName f2 2023-02-16 18:01:10,852 INFO [StoreOpener-1950baaa39bd11f61420d802e58dc470-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1950baaa39bd11f61420d802e58dc470 2023-02-16 18:01:10,853 INFO [StoreOpener-f8eb7c082b6f65c6ec1c2a7d5837aec5-1] regionserver.HStore(310): Store=f8eb7c082b6f65c6ec1c2a7d5837aec5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:10,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5 2023-02-16 18:01:10,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5 2023-02-16 18:01:10,860 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=15 2023-02-16 18:01:10,860 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=15, state=SUCCESS; OpenRegionProcedure 70d5f9a2baf8a4ffb3bc7c7c9109edc6, server=jenkins-hbase4.apache.org,42055,1676570465939 in 222 msec 2023-02-16 18:01:10,860 DEBUG [StoreOpener-1950baaa39bd11f61420d802e58dc470-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/f1 2023-02-16 18:01:10,861 DEBUG [StoreOpener-1950baaa39bd11f61420d802e58dc470-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/f1 2023-02-16 18:01:10,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:10,862 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=70d5f9a2baf8a4ffb3bc7c7c9109edc6, ASSIGN in 410 msec 2023-02-16 18:01:10,862 INFO [StoreOpener-1950baaa39bd11f61420d802e58dc470-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1950baaa39bd11f61420d802e58dc470 columnFamilyName f1 2023-02-16 18:01:10,863 INFO [StoreOpener-1950baaa39bd11f61420d802e58dc470-1] regionserver.HStore(310): Store=1950baaa39bd11f61420d802e58dc470/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:10,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f8eb7c082b6f65c6ec1c2a7d5837aec5 2023-02-16 18:01:10,863 INFO [StoreOpener-1950baaa39bd11f61420d802e58dc470-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1950baaa39bd11f61420d802e58dc470 2023-02-16 18:01:10,867 DEBUG [StoreOpener-1950baaa39bd11f61420d802e58dc470-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/f2 2023-02-16 18:01:10,867 DEBUG [StoreOpener-1950baaa39bd11f61420d802e58dc470-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/f2 2023-02-16 18:01:10,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:10,868 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f8eb7c082b6f65c6ec1c2a7d5837aec5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63533404, jitterRate=-0.05327850580215454}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:10,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f8eb7c082b6f65c6ec1c2a7d5837aec5: 2023-02-16 18:01:10,868 INFO [StoreOpener-1950baaa39bd11f61420d802e58dc470-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1950baaa39bd11f61420d802e58dc470 columnFamilyName f2 2023-02-16 18:01:10,869 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5., pid=21, masterSystemTime=1676570470774 2023-02-16 18:01:10,869 INFO [StoreOpener-1950baaa39bd11f61420d802e58dc470-1] regionserver.HStore(310): Store=1950baaa39bd11f61420d802e58dc470/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:10,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5. 2023-02-16 18:01:10,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470 2023-02-16 18:01:10,872 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5. 2023-02-16 18:01:10,873 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99. 2023-02-16 18:01:10,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3dbbccccab831fa7f061de6d7982cb99, NAME => 'testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-16 18:01:10,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470 2023-02-16 18:01:10,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 3dbbccccab831fa7f061de6d7982cb99 2023-02-16 18:01:10,873 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=f8eb7c082b6f65c6ec1c2a7d5837aec5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:10,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:10,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3dbbccccab831fa7f061de6d7982cb99 2023-02-16 18:01:10,873 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570470873"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676570470873"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676570470873"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676570470873"}]},"ts":"1676570470873"} 2023-02-16 18:01:10,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3dbbccccab831fa7f061de6d7982cb99 2023-02-16 18:01:10,877 INFO [StoreOpener-3dbbccccab831fa7f061de6d7982cb99-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3dbbccccab831fa7f061de6d7982cb99 2023-02-16 18:01:10,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:10,881 DEBUG [StoreOpener-3dbbccccab831fa7f061de6d7982cb99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/3dbbccccab831fa7f061de6d7982cb99/f1 2023-02-16 18:01:10,881 DEBUG [StoreOpener-3dbbccccab831fa7f061de6d7982cb99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/3dbbccccab831fa7f061de6d7982cb99/f1 2023-02-16 18:01:10,882 INFO [StoreOpener-3dbbccccab831fa7f061de6d7982cb99-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3dbbccccab831fa7f061de6d7982cb99 columnFamilyName f1 2023-02-16 18:01:10,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1950baaa39bd11f61420d802e58dc470 2023-02-16 18:01:10,882 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=16 2023-02-16 18:01:10,883 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=16, state=SUCCESS; OpenRegionProcedure f8eb7c082b6f65c6ec1c2a7d5837aec5, server=jenkins-hbase4.apache.org,43537,1676570465988 in 260 msec 2023-02-16 18:01:10,884 INFO [StoreOpener-3dbbccccab831fa7f061de6d7982cb99-1] regionserver.HStore(310): Store=3dbbccccab831fa7f061de6d7982cb99/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:10,884 INFO [StoreOpener-3dbbccccab831fa7f061de6d7982cb99-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3dbbccccab831fa7f061de6d7982cb99 2023-02-16 18:01:10,884 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f8eb7c082b6f65c6ec1c2a7d5837aec5, ASSIGN in 432 msec 2023-02-16 18:01:10,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:10,886 DEBUG [StoreOpener-3dbbccccab831fa7f061de6d7982cb99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/3dbbccccab831fa7f061de6d7982cb99/f2 2023-02-16 18:01:10,887 DEBUG [StoreOpener-3dbbccccab831fa7f061de6d7982cb99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/3dbbccccab831fa7f061de6d7982cb99/f2 2023-02-16 18:01:10,887 INFO [StoreOpener-3dbbccccab831fa7f061de6d7982cb99-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3dbbccccab831fa7f061de6d7982cb99 columnFamilyName f2 2023-02-16 18:01:10,887 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1950baaa39bd11f61420d802e58dc470; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64918284, jitterRate=-0.0326421856880188}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:10,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1950baaa39bd11f61420d802e58dc470: 2023-02-16 18:01:10,888 INFO [StoreOpener-3dbbccccab831fa7f061de6d7982cb99-1] regionserver.HStore(310): Store=3dbbccccab831fa7f061de6d7982cb99/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:10,889 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470., pid=27, masterSystemTime=1676570470788 2023-02-16 18:01:10,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/3dbbccccab831fa7f061de6d7982cb99 2023-02-16 18:01:10,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/3dbbccccab831fa7f061de6d7982cb99 2023-02-16 18:01:10,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470. 2023-02-16 18:01:10,892 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470. 2023-02-16 18:01:10,892 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676570469835.1ec804a87832ac193dda237561459798. 2023-02-16 18:01:10,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1ec804a87832ac193dda237561459798, NAME => 'testWithMapReduce,d\x84\x84,1676570469835.1ec804a87832ac193dda237561459798.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-16 18:01:10,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 1ec804a87832ac193dda237561459798 2023-02-16 18:01:10,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676570469835.1ec804a87832ac193dda237561459798.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:10,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1ec804a87832ac193dda237561459798 2023-02-16 18:01:10,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1ec804a87832ac193dda237561459798 2023-02-16 18:01:10,893 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=1950baaa39bd11f61420d802e58dc470, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:10,893 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570470893"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676570470893"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676570470893"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676570470893"}]},"ts":"1676570470893"} 2023-02-16 18:01:10,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:10,896 INFO [StoreOpener-1ec804a87832ac193dda237561459798-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1ec804a87832ac193dda237561459798 2023-02-16 18:01:10,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3dbbccccab831fa7f061de6d7982cb99 2023-02-16 18:01:10,899 DEBUG [StoreOpener-1ec804a87832ac193dda237561459798-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/f1 2023-02-16 18:01:10,899 DEBUG [StoreOpener-1ec804a87832ac193dda237561459798-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/f1 2023-02-16 18:01:10,900 INFO [StoreOpener-1ec804a87832ac193dda237561459798-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ec804a87832ac193dda237561459798 columnFamilyName f1 2023-02-16 18:01:10,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/3dbbccccab831fa7f061de6d7982cb99/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:10,901 INFO [StoreOpener-1ec804a87832ac193dda237561459798-1] regionserver.HStore(310): Store=1ec804a87832ac193dda237561459798/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:10,902 INFO [StoreOpener-1ec804a87832ac193dda237561459798-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1ec804a87832ac193dda237561459798 2023-02-16 18:01:10,902 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3dbbccccab831fa7f061de6d7982cb99; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61188784, jitterRate=-0.08821606636047363}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:10,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3dbbccccab831fa7f061de6d7982cb99: 2023-02-16 18:01:10,903 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=12 2023-02-16 18:01:10,903 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=12, state=SUCCESS; OpenRegionProcedure 1950baaa39bd11f61420d802e58dc470, server=jenkins-hbase4.apache.org,42055,1676570465939 in 265 msec 2023-02-16 18:01:10,903 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99., pid=24, masterSystemTime=1676570470774 2023-02-16 18:01:10,904 DEBUG [StoreOpener-1ec804a87832ac193dda237561459798-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/f2 2023-02-16 18:01:10,904 DEBUG [StoreOpener-1ec804a87832ac193dda237561459798-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/f2 2023-02-16 18:01:10,904 INFO [StoreOpener-1ec804a87832ac193dda237561459798-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ec804a87832ac193dda237561459798 columnFamilyName f2 2023-02-16 18:01:10,905 INFO [StoreOpener-1ec804a87832ac193dda237561459798-1] regionserver.HStore(310): Store=1ec804a87832ac193dda237561459798/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:10,905 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=1950baaa39bd11f61420d802e58dc470, ASSIGN in 453 msec 2023-02-16 18:01:10,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99. 2023-02-16 18:01:10,906 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99. 2023-02-16 18:01:10,906 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85. 2023-02-16 18:01:10,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0bcde8180cee91830f201cd407607b85, NAME => 'testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-16 18:01:10,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798 2023-02-16 18:01:10,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 0bcde8180cee91830f201cd407607b85 2023-02-16 18:01:10,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:10,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0bcde8180cee91830f201cd407607b85 2023-02-16 18:01:10,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0bcde8180cee91830f201cd407607b85 2023-02-16 18:01:10,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798 2023-02-16 18:01:10,908 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=3dbbccccab831fa7f061de6d7982cb99, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:10,908 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676570470908"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676570470908"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676570470908"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676570470908"}]},"ts":"1676570470908"} 2023-02-16 18:01:10,909 INFO [StoreOpener-0bcde8180cee91830f201cd407607b85-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0bcde8180cee91830f201cd407607b85 2023-02-16 18:01:10,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:10,913 DEBUG [StoreOpener-0bcde8180cee91830f201cd407607b85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/f1 2023-02-16 18:01:10,913 DEBUG [StoreOpener-0bcde8180cee91830f201cd407607b85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/f1 2023-02-16 18:01:10,913 INFO [StoreOpener-0bcde8180cee91830f201cd407607b85-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0bcde8180cee91830f201cd407607b85 columnFamilyName f1 2023-02-16 18:01:10,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1ec804a87832ac193dda237561459798 2023-02-16 18:01:10,914 INFO [StoreOpener-0bcde8180cee91830f201cd407607b85-1] regionserver.HStore(310): Store=0bcde8180cee91830f201cd407607b85/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:10,915 INFO [StoreOpener-0bcde8180cee91830f201cd407607b85-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0bcde8180cee91830f201cd407607b85 2023-02-16 18:01:10,916 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=20 2023-02-16 18:01:10,916 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=20, state=SUCCESS; OpenRegionProcedure 3dbbccccab831fa7f061de6d7982cb99, server=jenkins-hbase4.apache.org,43537,1676570465988 in 288 msec 2023-02-16 18:01:10,917 DEBUG [StoreOpener-0bcde8180cee91830f201cd407607b85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/f2 2023-02-16 18:01:10,918 DEBUG [StoreOpener-0bcde8180cee91830f201cd407607b85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/f2 2023-02-16 18:01:10,918 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3dbbccccab831fa7f061de6d7982cb99, ASSIGN in 466 msec 2023-02-16 18:01:10,918 INFO [StoreOpener-0bcde8180cee91830f201cd407607b85-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0bcde8180cee91830f201cd407607b85 columnFamilyName f2 2023-02-16 18:01:10,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:10,919 INFO [StoreOpener-0bcde8180cee91830f201cd407607b85-1] regionserver.HStore(310): Store=0bcde8180cee91830f201cd407607b85/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:10,919 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1ec804a87832ac193dda237561459798; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65916060, jitterRate=-0.01777416467666626}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:10,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1ec804a87832ac193dda237561459798: 2023-02-16 18:01:10,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85 2023-02-16 18:01:10,921 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676570469835.1ec804a87832ac193dda237561459798., pid=30, masterSystemTime=1676570470788 2023-02-16 18:01:10,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85 2023-02-16 18:01:10,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676570469835.1ec804a87832ac193dda237561459798. 2023-02-16 18:01:10,923 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676570469835.1ec804a87832ac193dda237561459798. 2023-02-16 18:01:10,924 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676570469835.15cb379e20ca93b338be353101a05169. 2023-02-16 18:01:10,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 15cb379e20ca93b338be353101a05169, NAME => 'testWithMapReduce,q\x11\x10,1676570469835.15cb379e20ca93b338be353101a05169.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-16 18:01:10,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 15cb379e20ca93b338be353101a05169 2023-02-16 18:01:10,924 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=1ec804a87832ac193dda237561459798, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:10,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676570469835.15cb379e20ca93b338be353101a05169.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:10,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 15cb379e20ca93b338be353101a05169 2023-02-16 18:01:10,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 15cb379e20ca93b338be353101a05169 2023-02-16 18:01:10,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:10,924 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676570469835.1ec804a87832ac193dda237561459798.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570470924"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676570470924"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676570470924"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676570470924"}]},"ts":"1676570470924"} 2023-02-16 18:01:10,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0bcde8180cee91830f201cd407607b85 2023-02-16 18:01:10,930 INFO [StoreOpener-15cb379e20ca93b338be353101a05169-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 15cb379e20ca93b338be353101a05169 2023-02-16 18:01:10,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:10,930 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=13 2023-02-16 18:01:10,930 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=13, state=SUCCESS; OpenRegionProcedure 1ec804a87832ac193dda237561459798, server=jenkins-hbase4.apache.org,42055,1676570465939 in 286 msec 2023-02-16 18:01:10,931 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0bcde8180cee91830f201cd407607b85; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73628374, jitterRate=0.09714826941490173}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:10,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0bcde8180cee91830f201cd407607b85: 2023-02-16 18:01:10,932 DEBUG [StoreOpener-15cb379e20ca93b338be353101a05169-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/f1 2023-02-16 18:01:10,933 DEBUG [StoreOpener-15cb379e20ca93b338be353101a05169-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/f1 2023-02-16 18:01:10,933 INFO [StoreOpener-15cb379e20ca93b338be353101a05169-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 15cb379e20ca93b338be353101a05169 columnFamilyName f1 2023-02-16 18:01:10,934 INFO [StoreOpener-15cb379e20ca93b338be353101a05169-1] regionserver.HStore(310): Store=15cb379e20ca93b338be353101a05169/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:10,934 INFO [StoreOpener-15cb379e20ca93b338be353101a05169-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 15cb379e20ca93b338be353101a05169 2023-02-16 18:01:10,936 DEBUG [StoreOpener-15cb379e20ca93b338be353101a05169-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/f2 2023-02-16 18:01:10,936 DEBUG [StoreOpener-15cb379e20ca93b338be353101a05169-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/f2 2023-02-16 18:01:10,937 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85., pid=25, masterSystemTime=1676570470774 2023-02-16 18:01:10,937 INFO [StoreOpener-15cb379e20ca93b338be353101a05169-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 15cb379e20ca93b338be353101a05169 columnFamilyName f2 2023-02-16 18:01:10,938 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=1ec804a87832ac193dda237561459798, ASSIGN in 480 msec 2023-02-16 18:01:10,938 INFO [StoreOpener-15cb379e20ca93b338be353101a05169-1] regionserver.HStore(310): Store=15cb379e20ca93b338be353101a05169/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:10,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85. 2023-02-16 18:01:10,940 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85. 2023-02-16 18:01:10,940 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad. 2023-02-16 18:01:10,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 510c37f08338dbe42f94233e8f445fad, NAME => 'testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-16 18:01:10,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169 2023-02-16 18:01:10,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 510c37f08338dbe42f94233e8f445fad 2023-02-16 18:01:10,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:10,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 510c37f08338dbe42f94233e8f445fad 2023-02-16 18:01:10,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 510c37f08338dbe42f94233e8f445fad 2023-02-16 18:01:10,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169 2023-02-16 18:01:10,942 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=0bcde8180cee91830f201cd407607b85, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:10,942 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676570469835.0bcde8180cee91830f201cd407607b85.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570470942"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676570470942"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676570470942"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676570470942"}]},"ts":"1676570470942"} 2023-02-16 18:01:10,944 INFO [StoreOpener-510c37f08338dbe42f94233e8f445fad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 510c37f08338dbe42f94233e8f445fad 2023-02-16 18:01:10,947 DEBUG [StoreOpener-510c37f08338dbe42f94233e8f445fad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/f1 2023-02-16 18:01:10,947 DEBUG [StoreOpener-510c37f08338dbe42f94233e8f445fad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/f1 2023-02-16 18:01:10,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:10,948 INFO [StoreOpener-510c37f08338dbe42f94233e8f445fad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 510c37f08338dbe42f94233e8f445fad columnFamilyName f1 2023-02-16 18:01:10,949 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=14 2023-02-16 18:01:10,949 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=14, state=SUCCESS; OpenRegionProcedure 0bcde8180cee91830f201cd407607b85, server=jenkins-hbase4.apache.org,43537,1676570465988 in 320 msec 2023-02-16 18:01:10,949 INFO [StoreOpener-510c37f08338dbe42f94233e8f445fad-1] regionserver.HStore(310): Store=510c37f08338dbe42f94233e8f445fad/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:10,950 INFO [StoreOpener-510c37f08338dbe42f94233e8f445fad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 510c37f08338dbe42f94233e8f445fad 2023-02-16 18:01:10,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 15cb379e20ca93b338be353101a05169 2023-02-16 18:01:10,952 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0bcde8180cee91830f201cd407607b85, ASSIGN in 499 msec 2023-02-16 18:01:10,953 DEBUG [StoreOpener-510c37f08338dbe42f94233e8f445fad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/f2 2023-02-16 18:01:10,953 DEBUG [StoreOpener-510c37f08338dbe42f94233e8f445fad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/f2 2023-02-16 18:01:10,953 INFO [StoreOpener-510c37f08338dbe42f94233e8f445fad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 510c37f08338dbe42f94233e8f445fad columnFamilyName f2 2023-02-16 18:01:10,954 INFO [StoreOpener-510c37f08338dbe42f94233e8f445fad-1] regionserver.HStore(310): Store=510c37f08338dbe42f94233e8f445fad/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:10,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad 2023-02-16 18:01:10,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:10,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad 2023-02-16 18:01:10,959 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 15cb379e20ca93b338be353101a05169; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60069450, jitterRate=-0.1048954427242279}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:10,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 15cb379e20ca93b338be353101a05169: 2023-02-16 18:01:10,960 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676570469835.15cb379e20ca93b338be353101a05169., pid=29, masterSystemTime=1676570470788 2023-02-16 18:01:10,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:10,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676570469835.15cb379e20ca93b338be353101a05169. 2023-02-16 18:01:10,963 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676570469835.15cb379e20ca93b338be353101a05169. 2023-02-16 18:01:10,963 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1. 2023-02-16 18:01:10,963 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=15cb379e20ca93b338be353101a05169, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:10,964 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676570469835.15cb379e20ca93b338be353101a05169.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570470963"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676570470963"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676570470963"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676570470963"}]},"ts":"1676570470963"} 2023-02-16 18:01:10,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 510c37f08338dbe42f94233e8f445fad 2023-02-16 18:01:10,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9ec2815f78d2a1df813f1db89d7687e1, NAME => 'testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-16 18:01:10,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 9ec2815f78d2a1df813f1db89d7687e1 2023-02-16 18:01:10,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:10,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9ec2815f78d2a1df813f1db89d7687e1 2023-02-16 18:01:10,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9ec2815f78d2a1df813f1db89d7687e1 2023-02-16 18:01:10,969 INFO [StoreOpener-9ec2815f78d2a1df813f1db89d7687e1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9ec2815f78d2a1df813f1db89d7687e1 2023-02-16 18:01:10,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:10,971 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 510c37f08338dbe42f94233e8f445fad; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63526420, jitterRate=-0.05338257551193237}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:10,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 510c37f08338dbe42f94233e8f445fad: 2023-02-16 18:01:10,972 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad., pid=23, masterSystemTime=1676570470774 2023-02-16 18:01:10,972 DEBUG [StoreOpener-9ec2815f78d2a1df813f1db89d7687e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/f1 2023-02-16 18:01:10,972 DEBUG [StoreOpener-9ec2815f78d2a1df813f1db89d7687e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/f1 2023-02-16 18:01:10,972 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=17 2023-02-16 18:01:10,973 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=17, state=SUCCESS; OpenRegionProcedure 15cb379e20ca93b338be353101a05169, server=jenkins-hbase4.apache.org,42055,1676570465939 in 330 msec 2023-02-16 18:01:10,973 INFO [StoreOpener-9ec2815f78d2a1df813f1db89d7687e1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9ec2815f78d2a1df813f1db89d7687e1 columnFamilyName f1 2023-02-16 18:01:10,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad. 2023-02-16 18:01:10,975 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad. 2023-02-16 18:01:10,975 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=15cb379e20ca93b338be353101a05169, ASSIGN in 522 msec 2023-02-16 18:01:10,975 INFO [StoreOpener-9ec2815f78d2a1df813f1db89d7687e1-1] regionserver.HStore(310): Store=9ec2815f78d2a1df813f1db89d7687e1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:10,975 INFO [StoreOpener-9ec2815f78d2a1df813f1db89d7687e1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9ec2815f78d2a1df813f1db89d7687e1 2023-02-16 18:01:10,976 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=510c37f08338dbe42f94233e8f445fad, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:10,976 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570470976"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676570470976"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676570470976"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676570470976"}]},"ts":"1676570470976"} 2023-02-16 18:01:10,980 DEBUG [StoreOpener-9ec2815f78d2a1df813f1db89d7687e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/f2 2023-02-16 18:01:10,980 DEBUG [StoreOpener-9ec2815f78d2a1df813f1db89d7687e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/f2 2023-02-16 18:01:10,981 INFO [StoreOpener-9ec2815f78d2a1df813f1db89d7687e1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9ec2815f78d2a1df813f1db89d7687e1 columnFamilyName f2 2023-02-16 18:01:10,981 INFO [StoreOpener-9ec2815f78d2a1df813f1db89d7687e1-1] regionserver.HStore(310): Store=9ec2815f78d2a1df813f1db89d7687e1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:10,982 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=19 2023-02-16 18:01:10,982 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=19, state=SUCCESS; OpenRegionProcedure 510c37f08338dbe42f94233e8f445fad, server=jenkins-hbase4.apache.org,43537,1676570465988 in 357 msec 2023-02-16 18:01:10,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1 2023-02-16 18:01:10,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1 2023-02-16 18:01:10,985 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=510c37f08338dbe42f94233e8f445fad, ASSIGN in 533 msec 2023-02-16 18:01:10,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:10,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 18:01:10,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9ec2815f78d2a1df813f1db89d7687e1 2023-02-16 18:01:10,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:10,995 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9ec2815f78d2a1df813f1db89d7687e1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59824732, jitterRate=-0.10854202508926392}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:10,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9ec2815f78d2a1df813f1db89d7687e1: 2023-02-16 18:01:10,996 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1., pid=28, masterSystemTime=1676570470788 2023-02-16 18:01:10,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1. 2023-02-16 18:01:10,998 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1. 2023-02-16 18:01:10,999 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=9ec2815f78d2a1df813f1db89d7687e1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:10,999 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570470999"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676570470999"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676570470999"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676570470999"}]},"ts":"1676570470999"} 2023-02-16 18:01:11,004 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=18 2023-02-16 18:01:11,004 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=18, state=SUCCESS; OpenRegionProcedure 9ec2815f78d2a1df813f1db89d7687e1, server=jenkins-hbase4.apache.org,42055,1676570465939 in 367 msec 2023-02-16 18:01:11,007 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=18, resume processing ppid=10 2023-02-16 18:01:11,007 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9ec2815f78d2a1df813f1db89d7687e1, ASSIGN in 554 msec 2023-02-16 18:01:11,009 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 18:01:11,009 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676570471009"}]},"ts":"1676570471009"} 2023-02-16 18:01:11,011 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-16 18:01:11,015 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 18:01:11,018 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 1.1750 sec 2023-02-16 18:01:11,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 18:01:11,994 INFO [Listener at localhost/45407] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-16 18:01:11,994 DEBUG [Listener at localhost/45407] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-16 18:01:11,997 INFO [Listener at localhost/45407] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 18:01:12,005 INFO [Listener at localhost/45407] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-16 18:01:12,006 INFO [Listener at localhost/45407] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 18:01:12,007 INFO [Listener at localhost/45407] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-16 18:01:12,007 INFO [Listener at localhost/45407] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-16 18:01:12,156 DEBUG [hconnection-0x4ddf350c-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 18:01:12,193 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43537] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6760 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85. 2023-02-16 18:01:12,195 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46936, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 18:01:12,215 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42055] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 10816 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470. 2023-02-16 18:01:12,503 INFO [Listener at localhost/45407] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-16 18:01:12,507 INFO [Listener at localhost/45407] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-16 18:01:12,521 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 18:01:12,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676570472521 (current time:1676570472521). 2023-02-16 18:01:12,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-16 18:01:12,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] zookeeper.ReadOnlyZKClient(139): Connect 0x68f9dc7e to 127.0.0.1:59495 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 18:01:12,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ac962c4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 18:01:12,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 18:01:12,539 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32778, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 18:01:12,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68f9dc7e to 127.0.0.1:59495 2023-02-16 18:01:12,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:12,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-16 18:01:12,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 18:01:12,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 18:01:12,570 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 18:01:12,571 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676571072571 2023-02-16 18:01:12,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 18:01:12,575 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-16 18:01:12,576 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 18:01:12,578 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 18:01:12,578 DEBUG [Listener at localhost/45407] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-16 18:01:12,579 DEBUG [Listener at localhost/45407] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-16 18:01:12,579 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 18 msec 2023-02-16 18:01:12,580 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 18:01:12,581 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676571072581 2023-02-16 18:01:12,611 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-16 18:01:12,611 INFO [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-16 18:01:12,611 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 18:01:12,612 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-16 18:01:12,612 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-16 18:01:12,612 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 18:01:12,612 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-16 18:01:12,614 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): regionserver:43537-0x1005e4af84e0002, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 18:01:12,614 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): regionserver:42055-0x1005e4af84e0001, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 18:01:12,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 18:01:12,614 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:12,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:12,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 18:01:12,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:12,615 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:12,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-16 18:01:12,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-16 18:01:12,615 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:12,615 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43537-0x1005e4af84e0002, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 18:01:12,615 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:12,615 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42055-0x1005e4af84e0001, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 18:01:12,615 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 18:01:12,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-16 18:01:12,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-16 18:01:12,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-16 18:01:12,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-16 18:01:12,616 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-16 18:01:12,616 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-16 18:01:12,618 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-16 18:01:12,618 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-16 18:01:12,619 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-16 18:01:12,619 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-16 18:01:12,619 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 18:01:12,619 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 18:01:12,619 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-16 18:01:12,619 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-16 18:01:12,619 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-16 18:01:12,619 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-16 18:01:12,619 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42055,1676570465939' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-16 18:01:12,619 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43537,1676570465988' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-16 18:01:12,622 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:12,622 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 18:01:12,622 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:12,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:12,622 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 18:01:12,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:12,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 18:01:12,623 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42055-0x1005e4af84e0001, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 18:01:12,623 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 18:01:12,623 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43537-0x1005e4af84e0002, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 18:01:12,623 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 18:01:12,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:12,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:12,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 18:01:12,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:12,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:12,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:12,625 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43537,1676570465988' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-16 18:01:12,626 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57897596[Count = 1] remaining members to acquire global barrier 2023-02-16 18:01:12,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:12,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:12,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 18:01:12,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:12,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:12,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 18:01:12,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:12,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:12,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:12,628 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42055,1676570465939' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-16 18:01:12,628 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57897596[Count = 0] remaining members to acquire global barrier 2023-02-16 18:01:12,628 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-16 18:01:12,628 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 18:01:12,630 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): regionserver:42055-0x1005e4af84e0001, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 18:01:12,630 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): regionserver:43537-0x1005e4af84e0002, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 18:01:12,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 18:01:12,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 18:01:12,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 18:01:12,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 18:01:12,630 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-16 18:01:12,630 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-16 18:01:12,630 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:12,631 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:12,631 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 18:01:12,632 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470. 2023-02-16 18:01:12,632 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85. 2023-02-16 18:01:12,632 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676570469835.1ec804a87832ac193dda237561459798. 2023-02-16 18:01:12,632 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85. started... 2023-02-16 18:01:12,632 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470. started... 2023-02-16 18:01:12,632 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676570469835.1ec804a87832ac193dda237561459798. started... 2023-02-16 18:01:12,632 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6. 2023-02-16 18:01:12,633 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6. started... 2023-02-16 18:01:12,636 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-16 18:01:12,636 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676570469835.15cb379e20ca93b338be353101a05169. 2023-02-16 18:01:12,636 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 1950baaa39bd11f61420d802e58dc470 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-16 18:01:12,636 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad. 2023-02-16 18:01:12,636 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676570469835.15cb379e20ca93b338be353101a05169. started... 2023-02-16 18:01:12,636 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 1ec804a87832ac193dda237561459798 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 18:01:12,636 INFO [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 0bcde8180cee91830f201cd407607b85 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 18:01:12,637 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 15cb379e20ca93b338be353101a05169 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 18:01:12,636 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 18:01:12,636 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-16 18:01:12,637 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 18:01:12,636 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad. started... 2023-02-16 18:01:12,638 INFO [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 510c37f08338dbe42f94233e8f445fad 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-16 18:01:12,638 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for a846001b1c0ad7ee601f4b65dccb7fe6: 2023-02-16 18:01:12,639 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 18:01:12,644 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 18:01:12,649 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 18:01:12,649 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 18:01:12,679 DEBUG [Listener at localhost/45407] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 18:01:12,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 18:01:12,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-16 18:01:12,687 DEBUG [Listener at localhost/45407] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-16 18:01:12,688 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6. completed. 2023-02-16 18:01:12,688 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6. 2023-02-16 18:01:12,689 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99. 2023-02-16 18:01:12,689 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-16 18:01:12,689 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99. started... 2023-02-16 18:01:12,690 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 3dbbccccab831fa7f061de6d7982cb99: 2023-02-16 18:01:12,690 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 18:01:12,690 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 18:01:12,690 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 18:01:12,690 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 18:01:12,846 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/.tmp/f1/a8c612f4b521465bb3844c1ccded1cf5 2023-02-16 18:01:12,862 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/.tmp/f1/aeb6d2e136844d0ebb9fdc1c492e2673 2023-02-16 18:01:12,863 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/.tmp/f1/ea201ddc2acb4beea02f5ab7490bcc70 2023-02-16 18:01:12,887 DEBUG [Listener at localhost/45407] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 18:01:12,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 18:01:12,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-16 18:01:12,890 DEBUG [Listener at localhost/45407] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-16 18:01:12,944 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/.tmp/f2/1218918a7c044d92b88a04b6b9585acc 2023-02-16 18:01:12,952 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/.tmp/f2/4fb6a582b5eb454aabca1e34f68c8479 2023-02-16 18:01:12,953 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/.tmp/f2/ba96f74b4eaf479a8ae083636dc880a9 2023-02-16 18:01:12,963 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/.tmp/f1/aeb6d2e136844d0ebb9fdc1c492e2673 as hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/f1/aeb6d2e136844d0ebb9fdc1c492e2673 2023-02-16 18:01:12,963 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/.tmp/f1/a8c612f4b521465bb3844c1ccded1cf5 as hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/f1/a8c612f4b521465bb3844c1ccded1cf5 2023-02-16 18:01:12,968 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/.tmp/f1/ea201ddc2acb4beea02f5ab7490bcc70 as hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/f1/ea201ddc2acb4beea02f5ab7490bcc70 2023-02-16 18:01:12,975 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/f1/aeb6d2e136844d0ebb9fdc1c492e2673, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 18:01:12,978 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/.tmp/f2/1218918a7c044d92b88a04b6b9585acc as hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/f2/1218918a7c044d92b88a04b6b9585acc 2023-02-16 18:01:12,979 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/f1/a8c612f4b521465bb3844c1ccded1cf5, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 18:01:12,982 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/.tmp/f2/4fb6a582b5eb454aabca1e34f68c8479 as hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/f2/4fb6a582b5eb454aabca1e34f68c8479 2023-02-16 18:01:12,983 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/f1/ea201ddc2acb4beea02f5ab7490bcc70, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 18:01:12,985 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/.tmp/f2/ba96f74b4eaf479a8ae083636dc880a9 as hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/f2/ba96f74b4eaf479a8ae083636dc880a9 2023-02-16 18:01:12,992 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/f2/1218918a7c044d92b88a04b6b9585acc, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 18:01:12,993 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 15cb379e20ca93b338be353101a05169 in 356ms, sequenceid=5, compaction requested=false 2023-02-16 18:01:12,994 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/f2/4fb6a582b5eb454aabca1e34f68c8479, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 18:01:12,995 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-16 18:01:12,996 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 1950baaa39bd11f61420d802e58dc470 in 359ms, sequenceid=5, compaction requested=false 2023-02-16 18:01:12,996 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-16 18:01:12,998 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 1950baaa39bd11f61420d802e58dc470: 2023-02-16 18:01:12,998 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 15cb379e20ca93b338be353101a05169: 2023-02-16 18:01:12,998 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 18:01:12,998 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676570469835.15cb379e20ca93b338be353101a05169.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 18:01:12,998 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 18:01:12,999 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 18:01:12,999 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/f1/aeb6d2e136844d0ebb9fdc1c492e2673] hfiles 2023-02-16 18:01:12,999 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/f1/a8c612f4b521465bb3844c1ccded1cf5] hfiles 2023-02-16 18:01:12,999 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/f1/aeb6d2e136844d0ebb9fdc1c492e2673 for snapshot=testWithMapReduceMultiRegion 2023-02-16 18:01:12,999 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/f1/a8c612f4b521465bb3844c1ccded1cf5 for snapshot=testWithMapReduceMultiRegion 2023-02-16 18:01:13,000 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/f2/ba96f74b4eaf479a8ae083636dc880a9, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 18:01:13,002 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 1ec804a87832ac193dda237561459798 in 366ms, sequenceid=5, compaction requested=false 2023-02-16 18:01:13,002 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 1ec804a87832ac193dda237561459798: 2023-02-16 18:01:13,002 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676570469835.1ec804a87832ac193dda237561459798.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 18:01:13,002 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 18:01:13,002 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/f1/ea201ddc2acb4beea02f5ab7490bcc70] hfiles 2023-02-16 18:01:13,002 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/f1/ea201ddc2acb4beea02f5ab7490bcc70 for snapshot=testWithMapReduceMultiRegion 2023-02-16 18:01:13,003 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/f2/ba96f74b4eaf479a8ae083636dc880a9] hfiles 2023-02-16 18:01:13,003 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/f2/1218918a7c044d92b88a04b6b9585acc] hfiles 2023-02-16 18:01:13,003 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/f2/4fb6a582b5eb454aabca1e34f68c8479] hfiles 2023-02-16 18:01:13,004 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/f2/1218918a7c044d92b88a04b6b9585acc for snapshot=testWithMapReduceMultiRegion 2023-02-16 18:01:13,003 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/f2/ba96f74b4eaf479a8ae083636dc880a9 for snapshot=testWithMapReduceMultiRegion 2023-02-16 18:01:13,004 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/f2/4fb6a582b5eb454aabca1e34f68c8479 for snapshot=testWithMapReduceMultiRegion 2023-02-16 18:01:13,021 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676570469835.15cb379e20ca93b338be353101a05169. completed. 2023-02-16 18:01:13,021 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676570469835.15cb379e20ca93b338be353101a05169. 2023-02-16 18:01:13,021 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470. completed. 2023-02-16 18:01:13,021 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-16 18:01:13,021 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6. 2023-02-16 18:01:13,021 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470. 2023-02-16 18:01:13,021 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6. started... 2023-02-16 18:01:13,021 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-16 18:01:13,021 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1. 2023-02-16 18:01:13,022 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1. started... 2023-02-16 18:01:13,022 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676570469835.1ec804a87832ac193dda237561459798. completed. 2023-02-16 18:01:13,022 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676570469835.1ec804a87832ac193dda237561459798. 2023-02-16 18:01:13,022 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 70d5f9a2baf8a4ffb3bc7c7c9109edc6 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 18:01:13,022 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-16 18:01:13,022 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 9ec2815f78d2a1df813f1db89d7687e1 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 18:01:13,048 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/.tmp/f1/4c269342aa394e2287c00de41965d981 2023-02-16 18:01:13,049 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/.tmp/f1/2a4866627cc44f41abf8dd70e7d5a480 2023-02-16 18:01:13,084 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/.tmp/f2/b262d0351a424eea8629cb50735c515a 2023-02-16 18:01:13,084 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/.tmp/f2/05b04ac95e15495cbaf2060b19ae176d 2023-02-16 18:01:13,094 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/.tmp/f1/2a4866627cc44f41abf8dd70e7d5a480 as hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/f1/2a4866627cc44f41abf8dd70e7d5a480 2023-02-16 18:01:13,094 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/.tmp/f1/4c269342aa394e2287c00de41965d981 as hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/f1/4c269342aa394e2287c00de41965d981 2023-02-16 18:01:13,103 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/f1/2a4866627cc44f41abf8dd70e7d5a480, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 18:01:13,104 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/.tmp/f2/05b04ac95e15495cbaf2060b19ae176d as hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/f2/05b04ac95e15495cbaf2060b19ae176d 2023-02-16 18:01:13,106 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/f1/4c269342aa394e2287c00de41965d981, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 18:01:13,108 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/.tmp/f2/b262d0351a424eea8629cb50735c515a as hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/f2/b262d0351a424eea8629cb50735c515a 2023-02-16 18:01:13,112 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/f2/05b04ac95e15495cbaf2060b19ae176d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 18:01:13,113 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 9ec2815f78d2a1df813f1db89d7687e1 in 91ms, sequenceid=5, compaction requested=false 2023-02-16 18:01:13,113 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 9ec2815f78d2a1df813f1db89d7687e1: 2023-02-16 18:01:13,113 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 18:01:13,114 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 18:01:13,114 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/f1/2a4866627cc44f41abf8dd70e7d5a480] hfiles 2023-02-16 18:01:13,114 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/f1/2a4866627cc44f41abf8dd70e7d5a480 for snapshot=testWithMapReduceMultiRegion 2023-02-16 18:01:13,114 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/f2/05b04ac95e15495cbaf2060b19ae176d] hfiles 2023-02-16 18:01:13,114 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/f2/05b04ac95e15495cbaf2060b19ae176d for snapshot=testWithMapReduceMultiRegion 2023-02-16 18:01:13,115 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/f2/b262d0351a424eea8629cb50735c515a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 18:01:13,117 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 70d5f9a2baf8a4ffb3bc7c7c9109edc6 in 95ms, sequenceid=5, compaction requested=false 2023-02-16 18:01:13,117 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 70d5f9a2baf8a4ffb3bc7c7c9109edc6: 2023-02-16 18:01:13,117 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 18:01:13,117 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 18:01:13,117 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/f1/4c269342aa394e2287c00de41965d981] hfiles 2023-02-16 18:01:13,117 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/f1/4c269342aa394e2287c00de41965d981 for snapshot=testWithMapReduceMultiRegion 2023-02-16 18:01:13,117 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/f2/b262d0351a424eea8629cb50735c515a] hfiles 2023-02-16 18:01:13,117 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/f2/b262d0351a424eea8629cb50735c515a for snapshot=testWithMapReduceMultiRegion 2023-02-16 18:01:13,129 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1. completed. 2023-02-16 18:01:13,129 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1. 2023-02-16 18:01:13,129 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-16 18:01:13,131 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6. completed. 2023-02-16 18:01:13,131 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6. 2023-02-16 18:01:13,131 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-16 18:01:13,131 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-16 18:01:13,131 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:13,131 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-16 18:01:13,131 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,42055,1676570465939' in zk 2023-02-16 18:01:13,135 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:13,135 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-16 18:01:13,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:13,135 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:13,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:13,135 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-16 18:01:13,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 18:01:13,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:13,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:13,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 18:01:13,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:13,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:13,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:13,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 18:01:13,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:13,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,42055,1676570465939': 2023-02-16 18:01:13,139 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42055,1676570465939' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-16 18:01:13,162 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99. completed. 2023-02-16 18:01:13,162 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99. 2023-02-16 18:01:13,162 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5. 2023-02-16 18:01:13,162 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-16 18:01:13,162 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5. started... 2023-02-16 18:01:13,163 INFO [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-1] regionserver.HRegion(2744): Flushing f8eb7c082b6f65c6ec1c2a7d5837aec5 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 18:01:13,179 INFO [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/.tmp/f1/e04b273e45b14c558f2ac08e86a9d418 2023-02-16 18:01:13,190 DEBUG [Listener at localhost/45407] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 18:01:13,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 18:01:13,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-16 18:01:13,192 DEBUG [Listener at localhost/45407] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-16 18:01:13,202 INFO [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/.tmp/f2/24ed7afa71c44155857c43d62d2ebf58 2023-02-16 18:01:13,209 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/.tmp/f1/e04b273e45b14c558f2ac08e86a9d418 as hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/f1/e04b273e45b14c558f2ac08e86a9d418 2023-02-16 18:01:13,216 INFO [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/f1/e04b273e45b14c558f2ac08e86a9d418, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 18:01:13,217 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/.tmp/f2/24ed7afa71c44155857c43d62d2ebf58 as hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/f2/24ed7afa71c44155857c43d62d2ebf58 2023-02-16 18:01:13,225 INFO [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/f2/24ed7afa71c44155857c43d62d2ebf58, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 18:01:13,226 INFO [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for f8eb7c082b6f65c6ec1c2a7d5837aec5 in 63ms, sequenceid=5, compaction requested=false 2023-02-16 18:01:13,226 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for f8eb7c082b6f65c6ec1c2a7d5837aec5: 2023-02-16 18:01:13,226 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 18:01:13,226 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 18:01:13,227 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/f1/e04b273e45b14c558f2ac08e86a9d418] hfiles 2023-02-16 18:01:13,227 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/f1/e04b273e45b14c558f2ac08e86a9d418 for snapshot=testWithMapReduceMultiRegion 2023-02-16 18:01:13,227 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/f2/24ed7afa71c44155857c43d62d2ebf58] hfiles 2023-02-16 18:01:13,227 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/f2/24ed7afa71c44155857c43d62d2ebf58 for snapshot=testWithMapReduceMultiRegion 2023-02-16 18:01:13,236 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5. completed. 2023-02-16 18:01:13,236 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5. 2023-02-16 18:01:13,236 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-16 18:01:13,247 INFO [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/.tmp/f1/6fcfe3ef087543e4a7b9c0c4f83050a3 2023-02-16 18:01:13,262 INFO [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/.tmp/f1/13c59ae4248a4ca08ed5969f2f265224 2023-02-16 18:01:13,272 INFO [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/.tmp/f2/3a5e3b66285c4905b7489252b05455e4 2023-02-16 18:01:13,284 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/.tmp/f1/6fcfe3ef087543e4a7b9c0c4f83050a3 as hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/f1/6fcfe3ef087543e4a7b9c0c4f83050a3 2023-02-16 18:01:13,297 INFO [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/f1/6fcfe3ef087543e4a7b9c0c4f83050a3, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 18:01:13,298 INFO [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/.tmp/f2/eceec544f1524b37b04b78ed9bb32f76 2023-02-16 18:01:13,299 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/.tmp/f2/3a5e3b66285c4905b7489252b05455e4 as hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/f2/3a5e3b66285c4905b7489252b05455e4 2023-02-16 18:01:13,312 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/.tmp/f1/13c59ae4248a4ca08ed5969f2f265224 as hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/f1/13c59ae4248a4ca08ed5969f2f265224 2023-02-16 18:01:13,315 INFO [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/f2/3a5e3b66285c4905b7489252b05455e4, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 18:01:13,317 INFO [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 510c37f08338dbe42f94233e8f445fad in 679ms, sequenceid=5, compaction requested=false 2023-02-16 18:01:13,317 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 510c37f08338dbe42f94233e8f445fad: 2023-02-16 18:01:13,317 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 18:01:13,317 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 18:01:13,317 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/f1/6fcfe3ef087543e4a7b9c0c4f83050a3] hfiles 2023-02-16 18:01:13,317 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/f1/6fcfe3ef087543e4a7b9c0c4f83050a3 for snapshot=testWithMapReduceMultiRegion 2023-02-16 18:01:13,317 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/f2/3a5e3b66285c4905b7489252b05455e4] hfiles 2023-02-16 18:01:13,317 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/f2/3a5e3b66285c4905b7489252b05455e4 for snapshot=testWithMapReduceMultiRegion 2023-02-16 18:01:13,320 INFO [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/f1/13c59ae4248a4ca08ed5969f2f265224, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 18:01:13,321 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/.tmp/f2/eceec544f1524b37b04b78ed9bb32f76 as hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/f2/eceec544f1524b37b04b78ed9bb32f76 2023-02-16 18:01:13,329 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad. completed. 2023-02-16 18:01:13,329 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad. 2023-02-16 18:01:13,329 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-16 18:01:13,331 INFO [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/f2/eceec544f1524b37b04b78ed9bb32f76, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 18:01:13,332 INFO [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 0bcde8180cee91830f201cd407607b85 in 696ms, sequenceid=5, compaction requested=false 2023-02-16 18:01:13,333 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 0bcde8180cee91830f201cd407607b85: 2023-02-16 18:01:13,333 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 18:01:13,333 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 18:01:13,333 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/f1/13c59ae4248a4ca08ed5969f2f265224] hfiles 2023-02-16 18:01:13,333 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/f1/13c59ae4248a4ca08ed5969f2f265224 for snapshot=testWithMapReduceMultiRegion 2023-02-16 18:01:13,333 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/f2/eceec544f1524b37b04b78ed9bb32f76] hfiles 2023-02-16 18:01:13,333 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/f2/eceec544f1524b37b04b78ed9bb32f76 for snapshot=testWithMapReduceMultiRegion 2023-02-16 18:01:13,343 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85. completed. 2023-02-16 18:01:13,343 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85. 2023-02-16 18:01:13,343 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-16 18:01:13,343 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-16 18:01:13,343 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:13,343 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-16 18:01:13,343 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,43537,1676570465988' in zk 2023-02-16 18:01:13,346 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-16 18:01:13,346 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:13,346 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:13,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:13,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:13,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 18:01:13,346 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-16 18:01:13,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:13,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:13,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 18:01:13,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:13,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:13,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:13,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 18:01:13,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:13,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:13,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,43537,1676570465988': 2023-02-16 18:01:13,352 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43537,1676570465988' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-16 18:01:13,352 INFO [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-16 18:01:13,352 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 18:01:13,352 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 18:01:13,352 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-16 18:01:13,352 INFO [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-16 18:01:13,356 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): regionserver:43537-0x1005e4af84e0002, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 18:01:13,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 18:01:13,356 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): regionserver:42055-0x1005e4af84e0001, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 18:01:13,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 18:01:13,356 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 18:01:13,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 18:01:13,356 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): regionserver:43537-0x1005e4af84e0002, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 18:01:13,356 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): regionserver:42055-0x1005e4af84e0001, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 18:01:13,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 18:01:13,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:13,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 18:01:13,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 18:01:13,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 18:01:13,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:13,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 18:01:13,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:13,357 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:13,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:13,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 18:01:13,358 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:13,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 18:01:13,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 18:01:13,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:13,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 18:01:13,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:13,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:13,361 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:13,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:13,361 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:13,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 18:01:13,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:13,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:13,378 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:13,378 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): regionserver:43537-0x1005e4af84e0002, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 18:01:13,378 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-16 18:01:13,378 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): regionserver:42055-0x1005e4af84e0001, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 18:01:13,378 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:13,378 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): regionserver:42055-0x1005e4af84e0001, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 18:01:13,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 18:01:13,379 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:13,378 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): regionserver:43537-0x1005e4af84e0002, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 18:01:13,379 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-16 18:01:13,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:13,379 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-16 18:01:13,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-16 18:01:13,380 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:13,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 18:01:13,380 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 18:01:13,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:13,380 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:13,380 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 18:01:13,380 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 18:01:13,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 18:01:13,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:13,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 18:01:13,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:13,383 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-16 18:01:13,466 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-16 18:01:13,495 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-16 18:01:13,496 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-16 18:01:13,496 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-16 18:01:13,496 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676570472575Consolidate snapshot: testWithMapReduceMultiRegion at 1676570473380 (+805 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1676570473380Writing data manifest for testWithMapReduceMultiRegion at 1676570473414 (+34 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1676570473435 (+21 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1676570473495 (+60 ms) 2023-02-16 18:01:13,498 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 18:01:13,500 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 922 msec 2023-02-16 18:01:13,692 DEBUG [Listener at localhost/45407] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 18:01:13,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 18:01:13,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-16 18:01:13,695 INFO [Listener at localhost/45407] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-16 18:01:13,706 INFO [Listener at localhost/45407] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-16 18:01:13,719 INFO [Listener at localhost/45407] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-16 18:01:13,774 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43537] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6760 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85. 2023-02-16 18:01:13,803 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42055] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 10816 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470. 2023-02-16 18:01:13,927 INFO [Listener at localhost/45407] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-16 18:01:13,941 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-16 18:01:13,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-16 18:01:13,945 INFO [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-16 18:01:13,945 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 18:01:13,946 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-16 18:01:13,946 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-16 18:01:13,946 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:13,947 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 18:01:13,948 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): regionserver:43537-0x1005e4af84e0002, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 18:01:13,948 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): regionserver:42055-0x1005e4af84e0001, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 18:01:13,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 18:01:13,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 18:01:13,948 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:13,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:13,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:13,949 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:13,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 18:01:13,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 18:01:13,949 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:13,949 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43537-0x1005e4af84e0002, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:13,950 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:13,950 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 18:01:13,950 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42055-0x1005e4af84e0001, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:13,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 18:01:13,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 18:01:13,950 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-16 18:01:13,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 18:01:13,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 18:01:13,950 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-16 18:01:13,951 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-16 18:01:13,952 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-16 18:01:13,952 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-16 18:01:13,952 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 18:01:13,955 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-16 18:01:13,955 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-16 18:01:13,955 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 18:01:13,955 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-16 18:01:13,956 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470. 2023-02-16 18:01:13,956 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470. started... 2023-02-16 18:01:13,956 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85. 2023-02-16 18:01:13,956 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1950baaa39bd11f61420d802e58dc470 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-16 18:01:13,956 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85. started... 2023-02-16 18:01:13,956 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676570469835.1ec804a87832ac193dda237561459798. 2023-02-16 18:01:13,957 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676570469835.1ec804a87832ac193dda237561459798. started... 2023-02-16 18:01:13,957 INFO [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0bcde8180cee91830f201cd407607b85 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 18:01:13,957 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 1ec804a87832ac193dda237561459798 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 18:01:13,958 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-16 18:01:13,958 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6. 2023-02-16 18:01:13,958 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 18:01:13,958 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6. started... 2023-02-16 18:01:13,958 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for a846001b1c0ad7ee601f4b65dccb7fe6: 2023-02-16 18:01:13,958 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad. 2023-02-16 18:01:13,958 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6. 2023-02-16 18:01:13,958 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad. started... 2023-02-16 18:01:13,959 INFO [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 510c37f08338dbe42f94233e8f445fad 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-16 18:01:13,960 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99. 2023-02-16 18:01:13,960 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-16 18:01:13,960 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 18:01:13,960 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99. started... 2023-02-16 18:01:13,960 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676570469835.15cb379e20ca93b338be353101a05169. 2023-02-16 18:01:13,960 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 3dbbccccab831fa7f061de6d7982cb99: 2023-02-16 18:01:13,960 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-16 18:01:13,960 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99. 2023-02-16 18:01:13,960 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676570469835.15cb379e20ca93b338be353101a05169. started... 2023-02-16 18:01:13,960 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5. 2023-02-16 18:01:13,961 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5. started... 2023-02-16 18:01:13,960 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-16 18:01:13,961 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 15cb379e20ca93b338be353101a05169 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 18:01:13,961 INFO [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing f8eb7c082b6f65c6ec1c2a7d5837aec5 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 18:01:14,034 INFO [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/.tmp/f1/204fbfa5464a4ec0aaca1bd1ad488b92 2023-02-16 18:01:14,045 INFO [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/.tmp/f1/e9a7b963fbb3485e967d605bc1ce016a 2023-02-16 18:01:14,045 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/.tmp/f1/99c7c9c45c074ad19f949b3adb98b608 2023-02-16 18:01:14,048 INFO [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/.tmp/f1/da8175262809406788816c2b6b549d9f 2023-02-16 18:01:14,061 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/.tmp/f1/a816115d084d4f2aaa4ef24122c272c4 2023-02-16 18:01:14,076 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/.tmp/f1/9871aa5eded748c584a4e9d331cb2ce7 2023-02-16 18:01:14,096 INFO [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/.tmp/f2/35645d4df7f9473bb5557617b6dcb790 2023-02-16 18:01:14,105 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/.tmp/f1/204fbfa5464a4ec0aaca1bd1ad488b92 as hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/f1/204fbfa5464a4ec0aaca1bd1ad488b92 2023-02-16 18:01:14,112 INFO [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/f1/204fbfa5464a4ec0aaca1bd1ad488b92, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 18:01:14,114 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/.tmp/f2/35645d4df7f9473bb5557617b6dcb790 as hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/f2/35645d4df7f9473bb5557617b6dcb790 2023-02-16 18:01:14,116 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/.tmp/f2/f58aa8e89f3b4abdab7a2cf601725911 2023-02-16 18:01:14,121 INFO [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/f2/35645d4df7f9473bb5557617b6dcb790, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 18:01:14,122 INFO [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 0bcde8180cee91830f201cd407607b85 in 165ms, sequenceid=9, compaction requested=false 2023-02-16 18:01:14,123 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0bcde8180cee91830f201cd407607b85: 2023-02-16 18:01:14,123 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85. 2023-02-16 18:01:14,123 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-16 18:01:14,124 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/.tmp/f1/99c7c9c45c074ad19f949b3adb98b608 as hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/f1/99c7c9c45c074ad19f949b3adb98b608 2023-02-16 18:01:14,130 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/f1/99c7c9c45c074ad19f949b3adb98b608, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 18:01:14,131 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/.tmp/f2/f58aa8e89f3b4abdab7a2cf601725911 as hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/f2/f58aa8e89f3b4abdab7a2cf601725911 2023-02-16 18:01:14,139 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/f2/f58aa8e89f3b4abdab7a2cf601725911, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 18:01:14,140 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 1ec804a87832ac193dda237561459798 in 183ms, sequenceid=9, compaction requested=false 2023-02-16 18:01:14,140 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 1ec804a87832ac193dda237561459798: 2023-02-16 18:01:14,140 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676570469835.1ec804a87832ac193dda237561459798. 2023-02-16 18:01:14,144 INFO [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/.tmp/f2/2812262f89274514a56f3872f0ad6017 2023-02-16 18:01:14,145 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6. 2023-02-16 18:01:14,145 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-16 18:01:14,145 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6. started... 2023-02-16 18:01:14,145 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 70d5f9a2baf8a4ffb3bc7c7c9109edc6 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 18:01:14,159 INFO [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/.tmp/f2/7a87b5e6ff4d45b397db7bab5ca935e3 2023-02-16 18:01:14,161 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/.tmp/f1/e9a7b963fbb3485e967d605bc1ce016a as hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/f1/e9a7b963fbb3485e967d605bc1ce016a 2023-02-16 18:01:14,168 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/.tmp/f1/da8175262809406788816c2b6b549d9f as hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/f1/da8175262809406788816c2b6b549d9f 2023-02-16 18:01:14,169 INFO [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/f1/e9a7b963fbb3485e967d605bc1ce016a, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 18:01:14,171 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/.tmp/f2/2812262f89274514a56f3872f0ad6017 as hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/f2/2812262f89274514a56f3872f0ad6017 2023-02-16 18:01:14,176 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/.tmp/f2/836d70dd55074a8d83bbba7ce7f219ce 2023-02-16 18:01:14,176 INFO [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/f1/da8175262809406788816c2b6b549d9f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 18:01:14,178 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/.tmp/f2/7a87b5e6ff4d45b397db7bab5ca935e3 as hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/f2/7a87b5e6ff4d45b397db7bab5ca935e3 2023-02-16 18:01:14,184 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/.tmp/f2/7c11ef3f33014f029b5c94ccb3d93d51 2023-02-16 18:01:14,185 INFO [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/f2/2812262f89274514a56f3872f0ad6017, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 18:01:14,186 INFO [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 510c37f08338dbe42f94233e8f445fad in 228ms, sequenceid=9, compaction requested=false 2023-02-16 18:01:14,186 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 510c37f08338dbe42f94233e8f445fad: 2023-02-16 18:01:14,186 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad. 2023-02-16 18:01:14,186 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-16 18:01:14,193 INFO [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/f2/7a87b5e6ff4d45b397db7bab5ca935e3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 18:01:14,194 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/.tmp/f1/8e5dd9db82bb46c3ad72a90523122283 2023-02-16 18:01:14,195 INFO [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for f8eb7c082b6f65c6ec1c2a7d5837aec5 in 233ms, sequenceid=9, compaction requested=false 2023-02-16 18:01:14,195 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for f8eb7c082b6f65c6ec1c2a7d5837aec5: 2023-02-16 18:01:14,195 DEBUG [rs(jenkins-hbase4.apache.org,43537,1676570465988)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5. 2023-02-16 18:01:14,195 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/.tmp/f1/9871aa5eded748c584a4e9d331cb2ce7 as hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/f1/9871aa5eded748c584a4e9d331cb2ce7 2023-02-16 18:01:14,195 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-16 18:01:14,195 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-16 18:01:14,195 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:14,195 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-16 18:01:14,195 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43537,1676570465988' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-16 18:01:14,196 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/.tmp/f1/a816115d084d4f2aaa4ef24122c272c4 as hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/f1/a816115d084d4f2aaa4ef24122c272c4 2023-02-16 18:01:14,199 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:14,199 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 18:01:14,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:14,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:14,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 18:01:14,199 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43537-0x1005e4af84e0002, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 18:01:14,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:14,199 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 18:01:14,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:14,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 18:01:14,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:14,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:14,202 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43537,1676570465988' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-16 18:01:14,202 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6762c595[Count = 1] remaining members to acquire global barrier 2023-02-16 18:01:14,204 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/f1/9871aa5eded748c584a4e9d331cb2ce7, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 18:01:14,205 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/.tmp/f2/836d70dd55074a8d83bbba7ce7f219ce as hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/f2/836d70dd55074a8d83bbba7ce7f219ce 2023-02-16 18:01:14,205 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/f1/a816115d084d4f2aaa4ef24122c272c4, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 18:01:14,206 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/.tmp/f2/7c11ef3f33014f029b5c94ccb3d93d51 as hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/f2/7c11ef3f33014f029b5c94ccb3d93d51 2023-02-16 18:01:14,215 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/f2/836d70dd55074a8d83bbba7ce7f219ce, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 18:01:14,216 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 1950baaa39bd11f61420d802e58dc470 in 260ms, sequenceid=9, compaction requested=false 2023-02-16 18:01:14,217 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1950baaa39bd11f61420d802e58dc470: 2023-02-16 18:01:14,217 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470. 2023-02-16 18:01:14,217 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1. 2023-02-16 18:01:14,217 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-16 18:01:14,217 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1. started... 2023-02-16 18:01:14,217 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 9ec2815f78d2a1df813f1db89d7687e1 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 18:01:14,220 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/f2/7c11ef3f33014f029b5c94ccb3d93d51, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 18:01:14,221 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 15cb379e20ca93b338be353101a05169 in 261ms, sequenceid=9, compaction requested=false 2023-02-16 18:01:14,221 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 15cb379e20ca93b338be353101a05169: 2023-02-16 18:01:14,221 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676570469835.15cb379e20ca93b338be353101a05169. 2023-02-16 18:01:14,221 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-16 18:01:14,224 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/.tmp/f2/b7aa608521aa45559d3ec7d95c0ce795 2023-02-16 18:01:14,230 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/.tmp/f1/8e5dd9db82bb46c3ad72a90523122283 as hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/f1/8e5dd9db82bb46c3ad72a90523122283 2023-02-16 18:01:14,232 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/.tmp/f1/2ed331b01f2c4545bae6b867845197b0 2023-02-16 18:01:14,237 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/f1/8e5dd9db82bb46c3ad72a90523122283, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 18:01:14,238 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/.tmp/f2/b7aa608521aa45559d3ec7d95c0ce795 as hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/f2/b7aa608521aa45559d3ec7d95c0ce795 2023-02-16 18:01:14,244 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/f2/b7aa608521aa45559d3ec7d95c0ce795, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 18:01:14,245 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 70d5f9a2baf8a4ffb3bc7c7c9109edc6 in 100ms, sequenceid=9, compaction requested=false 2023-02-16 18:01:14,245 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 70d5f9a2baf8a4ffb3bc7c7c9109edc6: 2023-02-16 18:01:14,246 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6. 2023-02-16 18:01:14,246 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-16 18:01:14,249 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/.tmp/f2/7c7727dd1040490c9d469574d2766a2c 2023-02-16 18:01:14,255 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/.tmp/f1/2ed331b01f2c4545bae6b867845197b0 as hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/f1/2ed331b01f2c4545bae6b867845197b0 2023-02-16 18:01:14,260 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/f1/2ed331b01f2c4545bae6b867845197b0, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 18:01:14,261 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/.tmp/f2/7c7727dd1040490c9d469574d2766a2c as hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/f2/7c7727dd1040490c9d469574d2766a2c 2023-02-16 18:01:14,267 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/f2/7c7727dd1040490c9d469574d2766a2c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 18:01:14,268 INFO [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 9ec2815f78d2a1df813f1db89d7687e1 in 51ms, sequenceid=9, compaction requested=false 2023-02-16 18:01:14,268 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 9ec2815f78d2a1df813f1db89d7687e1: 2023-02-16 18:01:14,268 DEBUG [rs(jenkins-hbase4.apache.org,42055,1676570465939)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1. 2023-02-16 18:01:14,268 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-16 18:01:14,268 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-16 18:01:14,268 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:14,268 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-16 18:01:14,268 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42055,1676570465939' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-16 18:01:14,270 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 18:01:14,270 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:14,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:14,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:14,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 18:01:14,270 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42055-0x1005e4af84e0001, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 18:01:14,270 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 18:01:14,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:14,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:14,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 18:01:14,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:14,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:14,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:14,273 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42055,1676570465939' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-16 18:01:14,273 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6762c595[Count = 0] remaining members to acquire global barrier 2023-02-16 18:01:14,273 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-16 18:01:14,273 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 18:01:14,276 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): regionserver:43537-0x1005e4af84e0002, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 18:01:14,276 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): regionserver:42055-0x1005e4af84e0001, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 18:01:14,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 18:01:14,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 18:01:14,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 18:01:14,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 18:01:14,276 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-16 18:01:14,276 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-16 18:01:14,276 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:14,276 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-16 18:01:14,276 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-16 18:01:14,276 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,42055,1676570465939' in zk 2023-02-16 18:01:14,277 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,43537,1676570465988' in zk 2023-02-16 18:01:14,277 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:14,277 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 18:01:14,279 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:14,279 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-16 18:01:14,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:14,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:14,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 18:01:14,279 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:14,279 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:14,279 DEBUG [member: 'jenkins-hbase4.apache.org,42055,1676570465939' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-16 18:01:14,279 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-16 18:01:14,279 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:14,280 DEBUG [member: 'jenkins-hbase4.apache.org,43537,1676570465988' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-16 18:01:14,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:14,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:14,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 18:01:14,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:14,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:14,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:14,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 18:01:14,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:14,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:14,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,42055,1676570465939': 2023-02-16 18:01:14,284 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42055,1676570465939' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-16 18:01:14,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:14,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:14,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 18:01:14,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:14,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:14,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 18:01:14,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:14,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:14,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:14,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 18:01:14,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:14,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:14,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,43537,1676570465988': 2023-02-16 18:01:14,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43537,1676570465988' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-16 18:01:14,287 INFO [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-16 18:01:14,287 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 18:01:14,287 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 18:01:14,287 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-16 18:01:14,288 INFO [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-16 18:01:14,290 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:14,290 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): regionserver:43537-0x1005e4af84e0002, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:14,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:14,290 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): regionserver:43537-0x1005e4af84e0002, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 18:01:14,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:14,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:14,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 18:01:14,290 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): regionserver:42055-0x1005e4af84e0001, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:14,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:14,290 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): regionserver:42055-0x1005e4af84e0001, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 18:01:14,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:14,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:14,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 18:01:14,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:14,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:14,291 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:14,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 18:01:14,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:14,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:14,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 18:01:14,291 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:14,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:14,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:14,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 18:01:14,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:14,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:14,293 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:14,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:14,294 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:14,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 18:01:14,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:14,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:14,299 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): regionserver:42055-0x1005e4af84e0001, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 18:01:14,299 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): regionserver:43537-0x1005e4af84e0002, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 18:01:14,299 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): regionserver:42055-0x1005e4af84e0001, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 18:01:14,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 18:01:14,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:14,299 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): regionserver:43537-0x1005e4af84e0002, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 18:01:14,299 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:14,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 18:01:14,300 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 18:01:14,300 DEBUG [(jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:14,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:14,300 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-16 18:01:14,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 18:01:14,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:14,300 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:14,300 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-16 18:01:14,301 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 18:01:14,301 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:14,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 18:01:14,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:14,301 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 18:01:14,301 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:14,301 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 18:01:14,301 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:14,303 DEBUG [Listener at localhost/45407] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-16 18:01:14,303 DEBUG [Listener at localhost/45407] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-16 18:01:14,320 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-16 18:01:14,378 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-16 18:01:14,378 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-16 18:01:14,403 DEBUG [Listener at localhost/45407] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-16 18:01:14,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-16 18:01:14,514 DEBUG [Listener at localhost/45407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9c71488a-f642-9649-d836-a74163cd870e/hadoop-3372553532586085870.jar 2023-02-16 18:01:14,530 INFO [Listener at localhost/45407] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676570472521 type: FLUSH version: 2 ttl: 0 2023-02-16 18:01:14,531 DEBUG [Listener at localhost/45407] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748/data/default/testWithMapReduce 2023-02-16 18:01:14,532 INFO [Listener at localhost/45407] snapshot.RestoreSnapshotHelper(239): region to add: 0bcde8180cee91830f201cd407607b85 2023-02-16 18:01:14,532 INFO [Listener at localhost/45407] snapshot.RestoreSnapshotHelper(239): region to add: 1ec804a87832ac193dda237561459798 2023-02-16 18:01:14,532 INFO [Listener at localhost/45407] snapshot.RestoreSnapshotHelper(239): region to add: 1950baaa39bd11f61420d802e58dc470 2023-02-16 18:01:14,532 INFO [Listener at localhost/45407] snapshot.RestoreSnapshotHelper(239): region to add: 15cb379e20ca93b338be353101a05169 2023-02-16 18:01:14,532 INFO [Listener at localhost/45407] snapshot.RestoreSnapshotHelper(239): region to add: a846001b1c0ad7ee601f4b65dccb7fe6 2023-02-16 18:01:14,533 INFO [Listener at localhost/45407] snapshot.RestoreSnapshotHelper(239): region to add: 510c37f08338dbe42f94233e8f445fad 2023-02-16 18:01:14,533 INFO [Listener at localhost/45407] snapshot.RestoreSnapshotHelper(239): region to add: 70d5f9a2baf8a4ffb3bc7c7c9109edc6 2023-02-16 18:01:14,533 INFO [Listener at localhost/45407] snapshot.RestoreSnapshotHelper(239): region to add: 3dbbccccab831fa7f061de6d7982cb99 2023-02-16 18:01:14,533 INFO [Listener at localhost/45407] snapshot.RestoreSnapshotHelper(239): region to add: 9ec2815f78d2a1df813f1db89d7687e1 2023-02-16 18:01:14,533 INFO [Listener at localhost/45407] snapshot.RestoreSnapshotHelper(239): region to add: f8eb7c082b6f65c6ec1c2a7d5837aec5 2023-02-16 18:01:14,533 INFO [Listener at localhost/45407] snapshot.RestoreSnapshotHelper(585): clone region=0bcde8180cee91830f201cd407607b85 as 0bcde8180cee91830f201cd407607b85 in snapshot testWithMapReduceMultiRegion 2023-02-16 18:01:14,533 INFO [Listener at localhost/45407] snapshot.RestoreSnapshotHelper(585): clone region=1ec804a87832ac193dda237561459798 as 1ec804a87832ac193dda237561459798 in snapshot testWithMapReduceMultiRegion 2023-02-16 18:01:14,533 INFO [Listener at localhost/45407] snapshot.RestoreSnapshotHelper(585): clone region=1950baaa39bd11f61420d802e58dc470 as 1950baaa39bd11f61420d802e58dc470 in snapshot testWithMapReduceMultiRegion 2023-02-16 18:01:14,534 INFO [Listener at localhost/45407] snapshot.RestoreSnapshotHelper(585): clone region=15cb379e20ca93b338be353101a05169 as 15cb379e20ca93b338be353101a05169 in snapshot testWithMapReduceMultiRegion 2023-02-16 18:01:14,534 INFO [Listener at localhost/45407] snapshot.RestoreSnapshotHelper(585): clone region=a846001b1c0ad7ee601f4b65dccb7fe6 as a846001b1c0ad7ee601f4b65dccb7fe6 in snapshot testWithMapReduceMultiRegion 2023-02-16 18:01:14,534 INFO [Listener at localhost/45407] snapshot.RestoreSnapshotHelper(585): clone region=510c37f08338dbe42f94233e8f445fad as 510c37f08338dbe42f94233e8f445fad in snapshot testWithMapReduceMultiRegion 2023-02-16 18:01:14,534 INFO [Listener at localhost/45407] snapshot.RestoreSnapshotHelper(585): clone region=70d5f9a2baf8a4ffb3bc7c7c9109edc6 as 70d5f9a2baf8a4ffb3bc7c7c9109edc6 in snapshot testWithMapReduceMultiRegion 2023-02-16 18:01:14,534 INFO [Listener at localhost/45407] snapshot.RestoreSnapshotHelper(585): clone region=3dbbccccab831fa7f061de6d7982cb99 as 3dbbccccab831fa7f061de6d7982cb99 in snapshot testWithMapReduceMultiRegion 2023-02-16 18:01:14,534 INFO [Listener at localhost/45407] snapshot.RestoreSnapshotHelper(585): clone region=9ec2815f78d2a1df813f1db89d7687e1 as 9ec2815f78d2a1df813f1db89d7687e1 in snapshot testWithMapReduceMultiRegion 2023-02-16 18:01:14,534 INFO [Listener at localhost/45407] snapshot.RestoreSnapshotHelper(585): clone region=f8eb7c082b6f65c6ec1c2a7d5837aec5 as f8eb7c082b6f65c6ec1c2a7d5837aec5 in snapshot testWithMapReduceMultiRegion 2023-02-16 18:01:14,538 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 1ec804a87832ac193dda237561459798, NAME => 'testWithMapReduce,d\x84\x84,1676570469835.1ec804a87832ac193dda237561459798.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748 2023-02-16 18:01:14,538 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 1950baaa39bd11f61420d802e58dc470, NAME => 'testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748 2023-02-16 18:01:14,539 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 510c37f08338dbe42f94233e8f445fad, NAME => 'testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748 2023-02-16 18:01:14,539 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => a846001b1c0ad7ee601f4b65dccb7fe6, NAME => 'testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748 2023-02-16 18:01:14,539 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 15cb379e20ca93b338be353101a05169, NAME => 'testWithMapReduce,q\x11\x10,1676570469835.15cb379e20ca93b338be353101a05169.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748 2023-02-16 18:01:14,539 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0bcde8180cee91830f201cd407607b85, NAME => 'testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748 2023-02-16 18:01:14,540 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 3dbbccccab831fa7f061de6d7982cb99, NAME => 'testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748 2023-02-16 18:01:14,540 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 70d5f9a2baf8a4ffb3bc7c7c9109edc6, NAME => 'testWithMapReduce,j\xCA\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748 2023-02-16 18:01:14,584 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676570469835.1ec804a87832ac193dda237561459798.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:14,585 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ea201ddc2acb4beea02f5ab7490bcc70 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 18:01:14,590 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676570469835.15cb379e20ca93b338be353101a05169.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:14,590 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink aeb6d2e136844d0ebb9fdc1c492e2673 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 18:01:14,598 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ba96f74b4eaf479a8ae083636dc880a9 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 18:01:14,604 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:14,604 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4c269342aa394e2287c00de41965d981 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 18:01:14,605 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 1ec804a87832ac193dda237561459798, disabling compactions & flushes 2023-02-16 18:01:14,605 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676570469835.1ec804a87832ac193dda237561459798. 2023-02-16 18:01:14,605 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676570469835.1ec804a87832ac193dda237561459798. 2023-02-16 18:01:14,605 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676570469835.1ec804a87832ac193dda237561459798. after waiting 0 ms 2023-02-16 18:01:14,605 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1218918a7c044d92b88a04b6b9585acc from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 18:01:14,605 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676570469835.1ec804a87832ac193dda237561459798. 2023-02-16 18:01:14,605 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676570469835.1ec804a87832ac193dda237561459798. 2023-02-16 18:01:14,605 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 1ec804a87832ac193dda237561459798: 2023-02-16 18:01:14,606 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 9ec2815f78d2a1df813f1db89d7687e1, NAME => 'testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748 2023-02-16 18:01:14,614 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:14,614 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 13c59ae4248a4ca08ed5969f2f265224 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 18:01:14,628 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:14,629 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6fcfe3ef087543e4a7b9c0c4f83050a3 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 18:01:14,629 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink eceec544f1524b37b04b78ed9bb32f76 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 18:01:14,629 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 15cb379e20ca93b338be353101a05169, disabling compactions & flushes 2023-02-16 18:01:14,629 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676570469835.15cb379e20ca93b338be353101a05169. 2023-02-16 18:01:14,629 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676570469835.15cb379e20ca93b338be353101a05169. 2023-02-16 18:01:14,629 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676570469835.15cb379e20ca93b338be353101a05169. after waiting 0 ms 2023-02-16 18:01:14,629 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676570469835.15cb379e20ca93b338be353101a05169. 2023-02-16 18:01:14,629 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676570469835.15cb379e20ca93b338be353101a05169. 2023-02-16 18:01:14,630 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 15cb379e20ca93b338be353101a05169: 2023-02-16 18:01:14,629 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:14,630 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b262d0351a424eea8629cb50735c515a from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 18:01:14,630 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => f8eb7c082b6f65c6ec1c2a7d5837aec5, NAME => 'testWithMapReduce,m\xED\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748 2023-02-16 18:01:14,631 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing a846001b1c0ad7ee601f4b65dccb7fe6, disabling compactions & flushes 2023-02-16 18:01:14,631 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6. 2023-02-16 18:01:14,631 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6. 2023-02-16 18:01:14,631 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6. after waiting 0 ms 2023-02-16 18:01:14,631 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6. 2023-02-16 18:01:14,631 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6. 2023-02-16 18:01:14,632 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for a846001b1c0ad7ee601f4b65dccb7fe6: 2023-02-16 18:01:14,636 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 70d5f9a2baf8a4ffb3bc7c7c9109edc6, disabling compactions & flushes 2023-02-16 18:01:14,638 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3a5e3b66285c4905b7489252b05455e4 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 18:01:14,636 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 0bcde8180cee91830f201cd407607b85, disabling compactions & flushes 2023-02-16 18:01:14,638 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6. 2023-02-16 18:01:14,638 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85. 2023-02-16 18:01:14,638 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6. 2023-02-16 18:01:14,638 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85. 2023-02-16 18:01:14,638 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6. after waiting 0 ms 2023-02-16 18:01:14,638 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85. after waiting 0 ms 2023-02-16 18:01:14,638 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6. 2023-02-16 18:01:14,638 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85. 2023-02-16 18:01:14,639 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6. 2023-02-16 18:01:14,639 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85. 2023-02-16 18:01:14,639 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 70d5f9a2baf8a4ffb3bc7c7c9109edc6: 2023-02-16 18:01:14,639 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 0bcde8180cee91830f201cd407607b85: 2023-02-16 18:01:14,648 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:14,648 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2a4866627cc44f41abf8dd70e7d5a480 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 18:01:14,648 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 510c37f08338dbe42f94233e8f445fad, disabling compactions & flushes 2023-02-16 18:01:14,648 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad. 2023-02-16 18:01:14,648 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad. 2023-02-16 18:01:14,648 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad. after waiting 0 ms 2023-02-16 18:01:14,648 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad. 2023-02-16 18:01:14,648 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad. 2023-02-16 18:01:14,648 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 510c37f08338dbe42f94233e8f445fad: 2023-02-16 18:01:14,652 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 05b04ac95e15495cbaf2060b19ae176d from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 18:01:14,655 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 9ec2815f78d2a1df813f1db89d7687e1, disabling compactions & flushes 2023-02-16 18:01:14,655 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1. 2023-02-16 18:01:14,655 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1. 2023-02-16 18:01:14,655 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1. after waiting 0 ms 2023-02-16 18:01:14,655 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1. 2023-02-16 18:01:14,655 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1. 2023-02-16 18:01:14,655 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 9ec2815f78d2a1df813f1db89d7687e1: 2023-02-16 18:01:14,656 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:14,657 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e04b273e45b14c558f2ac08e86a9d418 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 18:01:14,659 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 24ed7afa71c44155857c43d62d2ebf58 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 18:01:14,661 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing f8eb7c082b6f65c6ec1c2a7d5837aec5, disabling compactions & flushes 2023-02-16 18:01:14,661 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5. 2023-02-16 18:01:14,661 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5. 2023-02-16 18:01:14,661 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5. after waiting 0 ms 2023-02-16 18:01:14,661 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5. 2023-02-16 18:01:14,661 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5. 2023-02-16 18:01:14,661 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for f8eb7c082b6f65c6ec1c2a7d5837aec5: 2023-02-16 18:01:14,955 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 18:01:14,956 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-16 18:01:15,019 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:15,019 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 3dbbccccab831fa7f061de6d7982cb99, disabling compactions & flushes 2023-02-16 18:01:15,019 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99. 2023-02-16 18:01:15,019 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99. 2023-02-16 18:01:15,019 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99. after waiting 0 ms 2023-02-16 18:01:15,019 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99. 2023-02-16 18:01:15,019 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99. 2023-02-16 18:01:15,019 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 3dbbccccab831fa7f061de6d7982cb99: 2023-02-16 18:01:15,020 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:15,020 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a8c612f4b521465bb3844c1ccded1cf5 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 18:01:15,023 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4fb6a582b5eb454aabca1e34f68c8479 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 18:01:15,027 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 1950baaa39bd11f61420d802e58dc470, disabling compactions & flushes 2023-02-16 18:01:15,027 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470. 2023-02-16 18:01:15,027 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470. 2023-02-16 18:01:15,027 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470. after waiting 0 ms 2023-02-16 18:01:15,027 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470. 2023-02-16 18:01:15,027 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470. 2023-02-16 18:01:15,027 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 1950baaa39bd11f61420d802e58dc470: 2023-02-16 18:01:15,027 INFO [Listener at localhost/45407] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676570472521 type: FLUSH version: 2 ttl: 0 2023-02-16 18:01:15,028 DEBUG [Listener at localhost/45407] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748 2023-02-16 18:01:15,028 DEBUG [Listener at localhost/45407] util.CommonFSUtils(682): File system contents for path hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748 2023-02-16 18:01:15,029 DEBUG [Listener at localhost/45407] util.CommonFSUtils(699): |-data/ 2023-02-16 18:01:15,029 DEBUG [Listener at localhost/45407] util.CommonFSUtils(699): |----default/ 2023-02-16 18:01:15,030 DEBUG [Listener at localhost/45407] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-16 18:01:15,031 DEBUG [Listener at localhost/45407] util.CommonFSUtils(699): |----------0bcde8180cee91830f201cd407607b85/ 2023-02-16 18:01:15,032 DEBUG [Listener at localhost/45407] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 18:01:15,032 DEBUG [Listener at localhost/45407] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 18:01:15,032 DEBUG [Listener at localhost/45407] util.CommonFSUtils(702): |----------------testWithMapReduce=0bcde8180cee91830f201cd407607b85-13c59ae4248a4ca08ed5969f2f265224 2023-02-16 18:01:15,033 DEBUG [Listener at localhost/45407] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 18:01:15,033 DEBUG [Listener at localhost/45407] util.CommonFSUtils(702): |----------------testWithMapReduce=0bcde8180cee91830f201cd407607b85-eceec544f1524b37b04b78ed9bb32f76 2023-02-16 18:01:15,033 DEBUG [Listener at localhost/45407] util.CommonFSUtils(699): |----------15cb379e20ca93b338be353101a05169/ 2023-02-16 18:01:15,034 DEBUG [Listener at localhost/45407] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 18:01:15,034 DEBUG [Listener at localhost/45407] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 18:01:15,035 DEBUG [Listener at localhost/45407] util.CommonFSUtils(702): |----------------testWithMapReduce=15cb379e20ca93b338be353101a05169-aeb6d2e136844d0ebb9fdc1c492e2673 2023-02-16 18:01:15,035 DEBUG [Listener at localhost/45407] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 18:01:15,035 DEBUG [Listener at localhost/45407] util.CommonFSUtils(702): |----------------testWithMapReduce=15cb379e20ca93b338be353101a05169-1218918a7c044d92b88a04b6b9585acc 2023-02-16 18:01:15,035 DEBUG [Listener at localhost/45407] util.CommonFSUtils(699): |----------1950baaa39bd11f61420d802e58dc470/ 2023-02-16 18:01:15,036 DEBUG [Listener at localhost/45407] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 18:01:15,036 DEBUG [Listener at localhost/45407] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 18:01:15,037 DEBUG [Listener at localhost/45407] util.CommonFSUtils(702): |----------------testWithMapReduce=1950baaa39bd11f61420d802e58dc470-a8c612f4b521465bb3844c1ccded1cf5 2023-02-16 18:01:15,037 DEBUG [Listener at localhost/45407] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 18:01:15,038 DEBUG [Listener at localhost/45407] util.CommonFSUtils(702): |----------------testWithMapReduce=1950baaa39bd11f61420d802e58dc470-4fb6a582b5eb454aabca1e34f68c8479 2023-02-16 18:01:15,038 DEBUG [Listener at localhost/45407] util.CommonFSUtils(699): |----------1ec804a87832ac193dda237561459798/ 2023-02-16 18:01:15,039 DEBUG [Listener at localhost/45407] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 18:01:15,039 DEBUG [Listener at localhost/45407] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 18:01:15,039 DEBUG [Listener at localhost/45407] util.CommonFSUtils(702): |----------------testWithMapReduce=1ec804a87832ac193dda237561459798-ea201ddc2acb4beea02f5ab7490bcc70 2023-02-16 18:01:15,039 DEBUG [Listener at localhost/45407] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 18:01:15,040 DEBUG [Listener at localhost/45407] util.CommonFSUtils(702): |----------------testWithMapReduce=1ec804a87832ac193dda237561459798-ba96f74b4eaf479a8ae083636dc880a9 2023-02-16 18:01:15,040 DEBUG [Listener at localhost/45407] util.CommonFSUtils(699): |----------3dbbccccab831fa7f061de6d7982cb99/ 2023-02-16 18:01:15,041 DEBUG [Listener at localhost/45407] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 18:01:15,041 DEBUG [Listener at localhost/45407] util.CommonFSUtils(699): |----------510c37f08338dbe42f94233e8f445fad/ 2023-02-16 18:01:15,041 DEBUG [Listener at localhost/45407] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 18:01:15,042 DEBUG [Listener at localhost/45407] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 18:01:15,042 DEBUG [Listener at localhost/45407] util.CommonFSUtils(702): |----------------testWithMapReduce=510c37f08338dbe42f94233e8f445fad-6fcfe3ef087543e4a7b9c0c4f83050a3 2023-02-16 18:01:15,042 DEBUG [Listener at localhost/45407] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 18:01:15,043 DEBUG [Listener at localhost/45407] util.CommonFSUtils(702): |----------------testWithMapReduce=510c37f08338dbe42f94233e8f445fad-3a5e3b66285c4905b7489252b05455e4 2023-02-16 18:01:15,043 DEBUG [Listener at localhost/45407] util.CommonFSUtils(699): |----------70d5f9a2baf8a4ffb3bc7c7c9109edc6/ 2023-02-16 18:01:15,043 DEBUG [Listener at localhost/45407] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 18:01:15,044 DEBUG [Listener at localhost/45407] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 18:01:15,044 DEBUG [Listener at localhost/45407] util.CommonFSUtils(702): |----------------testWithMapReduce=70d5f9a2baf8a4ffb3bc7c7c9109edc6-4c269342aa394e2287c00de41965d981 2023-02-16 18:01:15,044 DEBUG [Listener at localhost/45407] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 18:01:15,045 DEBUG [Listener at localhost/45407] util.CommonFSUtils(702): |----------------testWithMapReduce=70d5f9a2baf8a4ffb3bc7c7c9109edc6-b262d0351a424eea8629cb50735c515a 2023-02-16 18:01:15,045 DEBUG [Listener at localhost/45407] util.CommonFSUtils(699): |----------9ec2815f78d2a1df813f1db89d7687e1/ 2023-02-16 18:01:15,045 DEBUG [Listener at localhost/45407] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 18:01:15,046 DEBUG [Listener at localhost/45407] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 18:01:15,046 DEBUG [Listener at localhost/45407] util.CommonFSUtils(702): |----------------testWithMapReduce=9ec2815f78d2a1df813f1db89d7687e1-2a4866627cc44f41abf8dd70e7d5a480 2023-02-16 18:01:15,046 DEBUG [Listener at localhost/45407] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 18:01:15,047 DEBUG [Listener at localhost/45407] util.CommonFSUtils(702): |----------------testWithMapReduce=9ec2815f78d2a1df813f1db89d7687e1-05b04ac95e15495cbaf2060b19ae176d 2023-02-16 18:01:15,047 DEBUG [Listener at localhost/45407] util.CommonFSUtils(699): |----------a846001b1c0ad7ee601f4b65dccb7fe6/ 2023-02-16 18:01:15,047 DEBUG [Listener at localhost/45407] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 18:01:15,048 DEBUG [Listener at localhost/45407] util.CommonFSUtils(699): |----------f8eb7c082b6f65c6ec1c2a7d5837aec5/ 2023-02-16 18:01:15,048 DEBUG [Listener at localhost/45407] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 18:01:15,048 DEBUG [Listener at localhost/45407] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 18:01:15,049 DEBUG [Listener at localhost/45407] util.CommonFSUtils(702): |----------------testWithMapReduce=f8eb7c082b6f65c6ec1c2a7d5837aec5-e04b273e45b14c558f2ac08e86a9d418 2023-02-16 18:01:15,049 DEBUG [Listener at localhost/45407] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 18:01:15,049 DEBUG [Listener at localhost/45407] util.CommonFSUtils(702): |----------------testWithMapReduce=f8eb7c082b6f65c6ec1c2a7d5837aec5-24ed7afa71c44155857c43d62d2ebf58 2023-02-16 18:01:15,057 DEBUG [Listener at localhost/45407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:15,058 DEBUG [Listener at localhost/45407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:15,058 DEBUG [Listener at localhost/45407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:15,059 DEBUG [Listener at localhost/45407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:15,059 DEBUG [Listener at localhost/45407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:15,060 DEBUG [Listener at localhost/45407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:15,060 DEBUG [Listener at localhost/45407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:15,130 DEBUG [Listener at localhost/45407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9c71488a-f642-9649-d836-a74163cd870e/hadoop-4964885645854821141.jar 2023-02-16 18:01:15,131 DEBUG [Listener at localhost/45407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:15,131 DEBUG [Listener at localhost/45407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:15,132 DEBUG [Listener at localhost/45407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:15,132 DEBUG [Listener at localhost/45407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:15,133 DEBUG [Listener at localhost/45407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:15,133 DEBUG [Listener at localhost/45407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:15,134 DEBUG [Listener at localhost/45407] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-16 18:01:15,134 DEBUG [Listener at localhost/45407] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-16 18:01:15,135 DEBUG [Listener at localhost/45407] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-16 18:01:15,135 DEBUG [Listener at localhost/45407] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-16 18:01:15,135 DEBUG [Listener at localhost/45407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-16 18:01:15,136 DEBUG [Listener at localhost/45407] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-16 18:01:15,136 DEBUG [Listener at localhost/45407] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-16 18:01:15,137 DEBUG [Listener at localhost/45407] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-16 18:01:15,137 DEBUG [Listener at localhost/45407] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-16 18:01:15,138 DEBUG [Listener at localhost/45407] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-16 18:01:15,143 DEBUG [Listener at localhost/45407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:15,143 DEBUG [Listener at localhost/45407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 18:01:15,144 DEBUG [Listener at localhost/45407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 18:01:15,144 DEBUG [Listener at localhost/45407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 18:01:15,144 DEBUG [Listener at localhost/45407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-16 18:01:15,211 DEBUG [Listener at localhost/45407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9c71488a-f642-9649-d836-a74163cd870e/hadoop-6146437864217836303.jar 2023-02-16 18:01:15,211 DEBUG [Listener at localhost/45407] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-16 18:01:15,260 WARN [Listener at localhost/45407] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-16 18:01:15,325 INFO [Listener at localhost/45407] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-16 18:01:15,739 WARN [Listener at localhost/45407] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9c71488a-f642-9649-d836-a74163cd870e/mapreduce.cluster.local.dir/1676570475626/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-16 18:01:15,740 WARN [Listener at localhost/45407] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9c71488a-f642-9649-d836-a74163cd870e/mapreduce.cluster.local.dir/1676570475626/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-16 18:01:15,894 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:15,894 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 18:01:15,898 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:15,901 INFO [StoreOpener-0bcde8180cee91830f201cd407607b85-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0bcde8180cee91830f201cd407607b85 2023-02-16 18:01:15,902 DEBUG [StoreOpener-0bcde8180cee91830f201cd407607b85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/f1 2023-02-16 18:01:15,902 INFO [StoreOpener-0bcde8180cee91830f201cd407607b85-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0bcde8180cee91830f201cd407607b85 columnFamilyName f1 2023-02-16 18:01:15,911 DEBUG [StoreOpener-0bcde8180cee91830f201cd407607b85-1] regionserver.HStore(539): loaded hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/f1/testWithMapReduce=0bcde8180cee91830f201cd407607b85-13c59ae4248a4ca08ed5969f2f265224 2023-02-16 18:01:15,912 INFO [StoreOpener-0bcde8180cee91830f201cd407607b85-1] regionserver.HStore(310): Store=0bcde8180cee91830f201cd407607b85/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:15,912 INFO [StoreOpener-0bcde8180cee91830f201cd407607b85-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0bcde8180cee91830f201cd407607b85 2023-02-16 18:01:15,914 DEBUG [StoreOpener-0bcde8180cee91830f201cd407607b85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/f2 2023-02-16 18:01:15,914 INFO [StoreOpener-0bcde8180cee91830f201cd407607b85-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0bcde8180cee91830f201cd407607b85 columnFamilyName f2 2023-02-16 18:01:15,920 DEBUG [StoreOpener-0bcde8180cee91830f201cd407607b85-1] regionserver.HStore(539): loaded hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/f2/testWithMapReduce=0bcde8180cee91830f201cd407607b85-eceec544f1524b37b04b78ed9bb32f76 2023-02-16 18:01:15,921 INFO [StoreOpener-0bcde8180cee91830f201cd407607b85-1] regionserver.HStore(310): Store=0bcde8180cee91830f201cd407607b85/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:15,921 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:15,921 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 0bcde8180cee91830f201cd407607b85; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63211118, jitterRate=-0.05808094143867493}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:15,921 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 0bcde8180cee91830f201cd407607b85: 2023-02-16 18:01:16,074 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 0bcde8180cee91830f201cd407607b85, disabling compactions & flushes 2023-02-16 18:01:16,075 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85. 2023-02-16 18:01:16,075 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85. 2023-02-16 18:01:16,075 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85. after waiting 0 ms 2023-02-16 18:01:16,075 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85. 2023-02-16 18:01:16,080 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85. 2023-02-16 18:01:16,080 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 0bcde8180cee91830f201cd407607b85: 2023-02-16 18:01:16,093 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:16,093 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 18:01:16,097 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:16,099 INFO [StoreOpener-510c37f08338dbe42f94233e8f445fad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 510c37f08338dbe42f94233e8f445fad 2023-02-16 18:01:16,100 DEBUG [StoreOpener-510c37f08338dbe42f94233e8f445fad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/f1 2023-02-16 18:01:16,101 INFO [StoreOpener-510c37f08338dbe42f94233e8f445fad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 510c37f08338dbe42f94233e8f445fad columnFamilyName f1 2023-02-16 18:01:16,107 DEBUG [StoreOpener-510c37f08338dbe42f94233e8f445fad-1] regionserver.HStore(539): loaded hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/f1/testWithMapReduce=510c37f08338dbe42f94233e8f445fad-6fcfe3ef087543e4a7b9c0c4f83050a3 2023-02-16 18:01:16,108 INFO [StoreOpener-510c37f08338dbe42f94233e8f445fad-1] regionserver.HStore(310): Store=510c37f08338dbe42f94233e8f445fad/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:16,108 INFO [StoreOpener-510c37f08338dbe42f94233e8f445fad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 510c37f08338dbe42f94233e8f445fad 2023-02-16 18:01:16,109 DEBUG [StoreOpener-510c37f08338dbe42f94233e8f445fad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/f2 2023-02-16 18:01:16,109 INFO [StoreOpener-510c37f08338dbe42f94233e8f445fad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 510c37f08338dbe42f94233e8f445fad columnFamilyName f2 2023-02-16 18:01:16,122 DEBUG [StoreOpener-510c37f08338dbe42f94233e8f445fad-1] regionserver.HStore(539): loaded hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/f2/testWithMapReduce=510c37f08338dbe42f94233e8f445fad-3a5e3b66285c4905b7489252b05455e4 2023-02-16 18:01:16,123 INFO [StoreOpener-510c37f08338dbe42f94233e8f445fad-1] regionserver.HStore(310): Store=510c37f08338dbe42f94233e8f445fad/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:16,124 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:16,124 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 510c37f08338dbe42f94233e8f445fad; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70204164, jitterRate=0.04612356424331665}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:16,124 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 510c37f08338dbe42f94233e8f445fad: 2023-02-16 18:01:16,180 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 510c37f08338dbe42f94233e8f445fad, disabling compactions & flushes 2023-02-16 18:01:16,180 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad. 2023-02-16 18:01:16,180 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad. 2023-02-16 18:01:16,180 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad. after waiting 0 ms 2023-02-16 18:01:16,180 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad. 2023-02-16 18:01:16,186 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad. 2023-02-16 18:01:16,186 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 510c37f08338dbe42f94233e8f445fad: 2023-02-16 18:01:16,192 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676570469835.1ec804a87832ac193dda237561459798.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:16,192 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 18:01:16,194 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:16,197 INFO [StoreOpener-1ec804a87832ac193dda237561459798-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1ec804a87832ac193dda237561459798 2023-02-16 18:01:16,198 DEBUG [StoreOpener-1ec804a87832ac193dda237561459798-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/f1 2023-02-16 18:01:16,199 INFO [StoreOpener-1ec804a87832ac193dda237561459798-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ec804a87832ac193dda237561459798 columnFamilyName f1 2023-02-16 18:01:16,208 DEBUG [StoreOpener-1ec804a87832ac193dda237561459798-1] regionserver.HStore(539): loaded hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/f1/testWithMapReduce=1ec804a87832ac193dda237561459798-ea201ddc2acb4beea02f5ab7490bcc70 2023-02-16 18:01:16,208 INFO [StoreOpener-1ec804a87832ac193dda237561459798-1] regionserver.HStore(310): Store=1ec804a87832ac193dda237561459798/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:16,208 INFO [StoreOpener-1ec804a87832ac193dda237561459798-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1ec804a87832ac193dda237561459798 2023-02-16 18:01:16,209 DEBUG [StoreOpener-1ec804a87832ac193dda237561459798-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/f2 2023-02-16 18:01:16,210 INFO [StoreOpener-1ec804a87832ac193dda237561459798-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ec804a87832ac193dda237561459798 columnFamilyName f2 2023-02-16 18:01:16,229 DEBUG [StoreOpener-1ec804a87832ac193dda237561459798-1] regionserver.HStore(539): loaded hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/f2/testWithMapReduce=1ec804a87832ac193dda237561459798-ba96f74b4eaf479a8ae083636dc880a9 2023-02-16 18:01:16,229 INFO [StoreOpener-1ec804a87832ac193dda237561459798-1] regionserver.HStore(310): Store=1ec804a87832ac193dda237561459798/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:16,229 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:16,230 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 1ec804a87832ac193dda237561459798; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65615307, jitterRate=-0.022255733609199524}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:16,230 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 1ec804a87832ac193dda237561459798: 2023-02-16 18:01:16,277 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 1ec804a87832ac193dda237561459798, disabling compactions & flushes 2023-02-16 18:01:16,277 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676570469835.1ec804a87832ac193dda237561459798. 2023-02-16 18:01:16,277 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676570469835.1ec804a87832ac193dda237561459798. 2023-02-16 18:01:16,277 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676570469835.1ec804a87832ac193dda237561459798. after waiting 0 ms 2023-02-16 18:01:16,277 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676570469835.1ec804a87832ac193dda237561459798. 2023-02-16 18:01:16,292 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676570469835.1ec804a87832ac193dda237561459798. 2023-02-16 18:01:16,292 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 1ec804a87832ac193dda237561459798: 2023-02-16 18:01:16,299 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:16,299 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 18:01:16,301 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:16,304 INFO [StoreOpener-9ec2815f78d2a1df813f1db89d7687e1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9ec2815f78d2a1df813f1db89d7687e1 2023-02-16 18:01:16,305 DEBUG [StoreOpener-9ec2815f78d2a1df813f1db89d7687e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/f1 2023-02-16 18:01:16,307 INFO [StoreOpener-9ec2815f78d2a1df813f1db89d7687e1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9ec2815f78d2a1df813f1db89d7687e1 columnFamilyName f1 2023-02-16 18:01:16,314 DEBUG [StoreOpener-9ec2815f78d2a1df813f1db89d7687e1-1] regionserver.HStore(539): loaded hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/f1/testWithMapReduce=9ec2815f78d2a1df813f1db89d7687e1-2a4866627cc44f41abf8dd70e7d5a480 2023-02-16 18:01:16,314 INFO [StoreOpener-9ec2815f78d2a1df813f1db89d7687e1-1] regionserver.HStore(310): Store=9ec2815f78d2a1df813f1db89d7687e1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:16,314 INFO [StoreOpener-9ec2815f78d2a1df813f1db89d7687e1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9ec2815f78d2a1df813f1db89d7687e1 2023-02-16 18:01:16,315 DEBUG [StoreOpener-9ec2815f78d2a1df813f1db89d7687e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/f2 2023-02-16 18:01:16,316 INFO [StoreOpener-9ec2815f78d2a1df813f1db89d7687e1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9ec2815f78d2a1df813f1db89d7687e1 columnFamilyName f2 2023-02-16 18:01:16,324 DEBUG [StoreOpener-9ec2815f78d2a1df813f1db89d7687e1-1] regionserver.HStore(539): loaded hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/f2/testWithMapReduce=9ec2815f78d2a1df813f1db89d7687e1-05b04ac95e15495cbaf2060b19ae176d 2023-02-16 18:01:16,325 INFO [StoreOpener-9ec2815f78d2a1df813f1db89d7687e1-1] regionserver.HStore(310): Store=9ec2815f78d2a1df813f1db89d7687e1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:16,325 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:16,325 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 9ec2815f78d2a1df813f1db89d7687e1; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69458759, jitterRate=0.03501616418361664}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:16,325 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 9ec2815f78d2a1df813f1db89d7687e1: 2023-02-16 18:01:16,417 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 9ec2815f78d2a1df813f1db89d7687e1, disabling compactions & flushes 2023-02-16 18:01:16,418 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1. 2023-02-16 18:01:16,418 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1. 2023-02-16 18:01:16,418 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1. after waiting 0 ms 2023-02-16 18:01:16,418 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1. 2023-02-16 18:01:16,421 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1. 2023-02-16 18:01:16,421 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 9ec2815f78d2a1df813f1db89d7687e1: 2023-02-16 18:01:16,427 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:16,427 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 18:01:16,433 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:16,436 INFO [StoreOpener-f8eb7c082b6f65c6ec1c2a7d5837aec5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f8eb7c082b6f65c6ec1c2a7d5837aec5 2023-02-16 18:01:16,437 DEBUG [StoreOpener-f8eb7c082b6f65c6ec1c2a7d5837aec5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/f1 2023-02-16 18:01:16,438 INFO [StoreOpener-f8eb7c082b6f65c6ec1c2a7d5837aec5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8eb7c082b6f65c6ec1c2a7d5837aec5 columnFamilyName f1 2023-02-16 18:01:16,445 DEBUG [StoreOpener-f8eb7c082b6f65c6ec1c2a7d5837aec5-1] regionserver.HStore(539): loaded hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/f1/testWithMapReduce=f8eb7c082b6f65c6ec1c2a7d5837aec5-e04b273e45b14c558f2ac08e86a9d418 2023-02-16 18:01:16,445 INFO [StoreOpener-f8eb7c082b6f65c6ec1c2a7d5837aec5-1] regionserver.HStore(310): Store=f8eb7c082b6f65c6ec1c2a7d5837aec5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:16,445 INFO [StoreOpener-f8eb7c082b6f65c6ec1c2a7d5837aec5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f8eb7c082b6f65c6ec1c2a7d5837aec5 2023-02-16 18:01:16,447 DEBUG [StoreOpener-f8eb7c082b6f65c6ec1c2a7d5837aec5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/f2 2023-02-16 18:01:16,447 INFO [StoreOpener-f8eb7c082b6f65c6ec1c2a7d5837aec5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8eb7c082b6f65c6ec1c2a7d5837aec5 columnFamilyName f2 2023-02-16 18:01:16,454 DEBUG [StoreOpener-f8eb7c082b6f65c6ec1c2a7d5837aec5-1] regionserver.HStore(539): loaded hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/f2/testWithMapReduce=f8eb7c082b6f65c6ec1c2a7d5837aec5-24ed7afa71c44155857c43d62d2ebf58 2023-02-16 18:01:16,454 INFO [StoreOpener-f8eb7c082b6f65c6ec1c2a7d5837aec5-1] regionserver.HStore(310): Store=f8eb7c082b6f65c6ec1c2a7d5837aec5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:16,455 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:16,455 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened f8eb7c082b6f65c6ec1c2a7d5837aec5; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71143644, jitterRate=0.060122907161712646}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:16,455 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for f8eb7c082b6f65c6ec1c2a7d5837aec5: 2023-02-16 18:01:16,497 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing f8eb7c082b6f65c6ec1c2a7d5837aec5, disabling compactions & flushes 2023-02-16 18:01:16,497 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5. 2023-02-16 18:01:16,497 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5. 2023-02-16 18:01:16,497 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5. after waiting 0 ms 2023-02-16 18:01:16,497 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5. 2023-02-16 18:01:16,503 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5. 2023-02-16 18:01:16,503 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for f8eb7c082b6f65c6ec1c2a7d5837aec5: 2023-02-16 18:01:16,510 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:16,510 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 18:01:16,517 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:16,519 INFO [StoreOpener-a846001b1c0ad7ee601f4b65dccb7fe6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a846001b1c0ad7ee601f4b65dccb7fe6 2023-02-16 18:01:16,521 DEBUG [StoreOpener-a846001b1c0ad7ee601f4b65dccb7fe6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748/data/default/testWithMapReduce/a846001b1c0ad7ee601f4b65dccb7fe6/f1 2023-02-16 18:01:16,521 INFO [StoreOpener-a846001b1c0ad7ee601f4b65dccb7fe6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a846001b1c0ad7ee601f4b65dccb7fe6 columnFamilyName f1 2023-02-16 18:01:16,522 INFO [StoreOpener-a846001b1c0ad7ee601f4b65dccb7fe6-1] regionserver.HStore(310): Store=a846001b1c0ad7ee601f4b65dccb7fe6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:16,522 INFO [StoreOpener-a846001b1c0ad7ee601f4b65dccb7fe6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a846001b1c0ad7ee601f4b65dccb7fe6 2023-02-16 18:01:16,523 DEBUG [StoreOpener-a846001b1c0ad7ee601f4b65dccb7fe6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748/data/default/testWithMapReduce/a846001b1c0ad7ee601f4b65dccb7fe6/f2 2023-02-16 18:01:16,524 INFO [StoreOpener-a846001b1c0ad7ee601f4b65dccb7fe6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a846001b1c0ad7ee601f4b65dccb7fe6 columnFamilyName f2 2023-02-16 18:01:16,524 INFO [StoreOpener-a846001b1c0ad7ee601f4b65dccb7fe6-1] regionserver.HStore(310): Store=a846001b1c0ad7ee601f4b65dccb7fe6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:16,524 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:16,524 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened a846001b1c0ad7ee601f4b65dccb7fe6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60197145, jitterRate=-0.10299263894557953}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:16,524 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for a846001b1c0ad7ee601f4b65dccb7fe6: 2023-02-16 18:01:16,542 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing a846001b1c0ad7ee601f4b65dccb7fe6, disabling compactions & flushes 2023-02-16 18:01:16,542 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6. 2023-02-16 18:01:16,542 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6. 2023-02-16 18:01:16,542 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6. after waiting 0 ms 2023-02-16 18:01:16,542 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6. 2023-02-16 18:01:16,542 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6. 2023-02-16 18:01:16,542 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for a846001b1c0ad7ee601f4b65dccb7fe6: 2023-02-16 18:01:16,547 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:16,547 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 18:01:16,548 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:16,549 INFO [StoreOpener-3dbbccccab831fa7f061de6d7982cb99-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3dbbccccab831fa7f061de6d7982cb99 2023-02-16 18:01:16,551 DEBUG [StoreOpener-3dbbccccab831fa7f061de6d7982cb99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748/data/default/testWithMapReduce/3dbbccccab831fa7f061de6d7982cb99/f1 2023-02-16 18:01:16,551 INFO [StoreOpener-3dbbccccab831fa7f061de6d7982cb99-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3dbbccccab831fa7f061de6d7982cb99 columnFamilyName f1 2023-02-16 18:01:16,552 INFO [StoreOpener-3dbbccccab831fa7f061de6d7982cb99-1] regionserver.HStore(310): Store=3dbbccccab831fa7f061de6d7982cb99/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:16,552 INFO [StoreOpener-3dbbccccab831fa7f061de6d7982cb99-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3dbbccccab831fa7f061de6d7982cb99 2023-02-16 18:01:16,554 DEBUG [StoreOpener-3dbbccccab831fa7f061de6d7982cb99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748/data/default/testWithMapReduce/3dbbccccab831fa7f061de6d7982cb99/f2 2023-02-16 18:01:16,554 INFO [StoreOpener-3dbbccccab831fa7f061de6d7982cb99-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3dbbccccab831fa7f061de6d7982cb99 columnFamilyName f2 2023-02-16 18:01:16,555 INFO [StoreOpener-3dbbccccab831fa7f061de6d7982cb99-1] regionserver.HStore(310): Store=3dbbccccab831fa7f061de6d7982cb99/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:16,555 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:16,555 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 3dbbccccab831fa7f061de6d7982cb99; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73995528, jitterRate=0.10261929035186768}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:16,555 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 3dbbccccab831fa7f061de6d7982cb99: 2023-02-16 18:01:16,576 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 3dbbccccab831fa7f061de6d7982cb99, disabling compactions & flushes 2023-02-16 18:01:16,576 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99. 2023-02-16 18:01:16,576 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99. 2023-02-16 18:01:16,576 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99. after waiting 0 ms 2023-02-16 18:01:16,576 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99. 2023-02-16 18:01:16,578 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99. 2023-02-16 18:01:16,578 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 3dbbccccab831fa7f061de6d7982cb99: 2023-02-16 18:01:16,584 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:16,584 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 18:01:16,585 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:16,587 INFO [StoreOpener-70d5f9a2baf8a4ffb3bc7c7c9109edc6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 70d5f9a2baf8a4ffb3bc7c7c9109edc6 2023-02-16 18:01:16,588 DEBUG [StoreOpener-70d5f9a2baf8a4ffb3bc7c7c9109edc6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/f1 2023-02-16 18:01:16,589 INFO [StoreOpener-70d5f9a2baf8a4ffb3bc7c7c9109edc6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 70d5f9a2baf8a4ffb3bc7c7c9109edc6 columnFamilyName f1 2023-02-16 18:01:16,596 DEBUG [StoreOpener-70d5f9a2baf8a4ffb3bc7c7c9109edc6-1] regionserver.HStore(539): loaded hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/f1/testWithMapReduce=70d5f9a2baf8a4ffb3bc7c7c9109edc6-4c269342aa394e2287c00de41965d981 2023-02-16 18:01:16,596 INFO [StoreOpener-70d5f9a2baf8a4ffb3bc7c7c9109edc6-1] regionserver.HStore(310): Store=70d5f9a2baf8a4ffb3bc7c7c9109edc6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:16,596 INFO [StoreOpener-70d5f9a2baf8a4ffb3bc7c7c9109edc6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 70d5f9a2baf8a4ffb3bc7c7c9109edc6 2023-02-16 18:01:16,598 DEBUG [StoreOpener-70d5f9a2baf8a4ffb3bc7c7c9109edc6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/f2 2023-02-16 18:01:16,598 INFO [StoreOpener-70d5f9a2baf8a4ffb3bc7c7c9109edc6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 70d5f9a2baf8a4ffb3bc7c7c9109edc6 columnFamilyName f2 2023-02-16 18:01:16,612 DEBUG [StoreOpener-70d5f9a2baf8a4ffb3bc7c7c9109edc6-1] regionserver.HStore(539): loaded hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/f2/testWithMapReduce=70d5f9a2baf8a4ffb3bc7c7c9109edc6-b262d0351a424eea8629cb50735c515a 2023-02-16 18:01:16,612 INFO [StoreOpener-70d5f9a2baf8a4ffb3bc7c7c9109edc6-1] regionserver.HStore(310): Store=70d5f9a2baf8a4ffb3bc7c7c9109edc6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:16,613 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:16,613 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 70d5f9a2baf8a4ffb3bc7c7c9109edc6; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68988180, jitterRate=0.028003990650177002}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:16,613 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 70d5f9a2baf8a4ffb3bc7c7c9109edc6: 2023-02-16 18:01:16,662 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 70d5f9a2baf8a4ffb3bc7c7c9109edc6, disabling compactions & flushes 2023-02-16 18:01:16,662 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6. 2023-02-16 18:01:16,662 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6. 2023-02-16 18:01:16,662 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6. after waiting 0 ms 2023-02-16 18:01:16,662 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6. 2023-02-16 18:01:16,673 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6. 2023-02-16 18:01:16,673 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 70d5f9a2baf8a4ffb3bc7c7c9109edc6: 2023-02-16 18:01:16,680 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676570469835.15cb379e20ca93b338be353101a05169.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:16,681 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 18:01:16,687 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:16,690 INFO [StoreOpener-15cb379e20ca93b338be353101a05169-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 15cb379e20ca93b338be353101a05169 2023-02-16 18:01:16,692 DEBUG [StoreOpener-15cb379e20ca93b338be353101a05169-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/f1 2023-02-16 18:01:16,692 INFO [StoreOpener-15cb379e20ca93b338be353101a05169-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 15cb379e20ca93b338be353101a05169 columnFamilyName f1 2023-02-16 18:01:16,704 DEBUG [StoreOpener-15cb379e20ca93b338be353101a05169-1] regionserver.HStore(539): loaded hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/f1/testWithMapReduce=15cb379e20ca93b338be353101a05169-aeb6d2e136844d0ebb9fdc1c492e2673 2023-02-16 18:01:16,704 INFO [StoreOpener-15cb379e20ca93b338be353101a05169-1] regionserver.HStore(310): Store=15cb379e20ca93b338be353101a05169/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:16,704 INFO [StoreOpener-15cb379e20ca93b338be353101a05169-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 15cb379e20ca93b338be353101a05169 2023-02-16 18:01:16,712 DEBUG [StoreOpener-15cb379e20ca93b338be353101a05169-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/f2 2023-02-16 18:01:16,712 INFO [StoreOpener-15cb379e20ca93b338be353101a05169-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 15cb379e20ca93b338be353101a05169 columnFamilyName f2 2023-02-16 18:01:16,724 DEBUG [StoreOpener-15cb379e20ca93b338be353101a05169-1] regionserver.HStore(539): loaded hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/f2/testWithMapReduce=15cb379e20ca93b338be353101a05169-1218918a7c044d92b88a04b6b9585acc 2023-02-16 18:01:16,724 INFO [StoreOpener-15cb379e20ca93b338be353101a05169-1] regionserver.HStore(310): Store=15cb379e20ca93b338be353101a05169/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:16,725 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:16,725 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 15cb379e20ca93b338be353101a05169; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72087949, jitterRate=0.07419414818286896}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:16,725 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 15cb379e20ca93b338be353101a05169: 2023-02-16 18:01:16,780 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 15cb379e20ca93b338be353101a05169, disabling compactions & flushes 2023-02-16 18:01:16,780 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676570469835.15cb379e20ca93b338be353101a05169. 2023-02-16 18:01:16,780 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676570469835.15cb379e20ca93b338be353101a05169. 2023-02-16 18:01:16,780 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676570469835.15cb379e20ca93b338be353101a05169. after waiting 0 ms 2023-02-16 18:01:16,780 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676570469835.15cb379e20ca93b338be353101a05169. 2023-02-16 18:01:16,787 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676570469835.15cb379e20ca93b338be353101a05169. 2023-02-16 18:01:16,787 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 15cb379e20ca93b338be353101a05169: 2023-02-16 18:01:16,791 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:16,791 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 18:01:16,794 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:16,796 INFO [StoreOpener-1950baaa39bd11f61420d802e58dc470-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1950baaa39bd11f61420d802e58dc470 2023-02-16 18:01:16,797 DEBUG [StoreOpener-1950baaa39bd11f61420d802e58dc470-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/f1 2023-02-16 18:01:16,798 INFO [StoreOpener-1950baaa39bd11f61420d802e58dc470-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1950baaa39bd11f61420d802e58dc470 columnFamilyName f1 2023-02-16 18:01:16,804 DEBUG [StoreOpener-1950baaa39bd11f61420d802e58dc470-1] regionserver.HStore(539): loaded hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/f1/testWithMapReduce=1950baaa39bd11f61420d802e58dc470-a8c612f4b521465bb3844c1ccded1cf5 2023-02-16 18:01:16,804 INFO [StoreOpener-1950baaa39bd11f61420d802e58dc470-1] regionserver.HStore(310): Store=1950baaa39bd11f61420d802e58dc470/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:16,804 INFO [StoreOpener-1950baaa39bd11f61420d802e58dc470-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1950baaa39bd11f61420d802e58dc470 2023-02-16 18:01:16,805 DEBUG [StoreOpener-1950baaa39bd11f61420d802e58dc470-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/f2 2023-02-16 18:01:16,806 INFO [StoreOpener-1950baaa39bd11f61420d802e58dc470-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1950baaa39bd11f61420d802e58dc470 columnFamilyName f2 2023-02-16 18:01:16,812 DEBUG [StoreOpener-1950baaa39bd11f61420d802e58dc470-1] regionserver.HStore(539): loaded hdfs://localhost:43129/user/jenkins/test-data/5f819c52-424d-cd3b-3e30-329791c5e75a/testWithMapReduceMultiRegion/289b9714-8132-4b93-9064-37da7e284748/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/f2/testWithMapReduce=1950baaa39bd11f61420d802e58dc470-4fb6a582b5eb454aabca1e34f68c8479 2023-02-16 18:01:16,812 INFO [StoreOpener-1950baaa39bd11f61420d802e58dc470-1] regionserver.HStore(310): Store=1950baaa39bd11f61420d802e58dc470/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:16,812 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:16,812 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 1950baaa39bd11f61420d802e58dc470; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75114681, jitterRate=0.11929596960544586}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:16,812 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 1950baaa39bd11f61420d802e58dc470: 2023-02-16 18:01:16,848 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 1950baaa39bd11f61420d802e58dc470, disabling compactions & flushes 2023-02-16 18:01:16,848 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470. 2023-02-16 18:01:16,848 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470. 2023-02-16 18:01:16,848 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470. after waiting 0 ms 2023-02-16 18:01:16,848 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470. 2023-02-16 18:01:16,851 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470. 2023-02-16 18:01:16,851 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 1950baaa39bd11f61420d802e58dc470: 2023-02-16 18:01:17,833 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceMultiRegion" 2023-02-16 18:01:17,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-16 18:01:17,840 INFO [Listener at localhost/45407] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-16 18:01:17,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-16 18:01:17,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-16 18:01:17,852 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676570477852"}]},"ts":"1676570477852"} 2023-02-16 18:01:17,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-16 18:01:17,854 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-16 18:01:17,856 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-16 18:01:17,860 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=a846001b1c0ad7ee601f4b65dccb7fe6, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=1950baaa39bd11f61420d802e58dc470, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=1ec804a87832ac193dda237561459798, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=0bcde8180cee91830f201cd407607b85, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=70d5f9a2baf8a4ffb3bc7c7c9109edc6, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=f8eb7c082b6f65c6ec1c2a7d5837aec5, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=15cb379e20ca93b338be353101a05169, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=9ec2815f78d2a1df813f1db89d7687e1, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=510c37f08338dbe42f94233e8f445fad, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=3dbbccccab831fa7f061de6d7982cb99, UNASSIGN}] 2023-02-16 18:01:17,863 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=510c37f08338dbe42f94233e8f445fad, UNASSIGN 2023-02-16 18:01:17,864 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=3dbbccccab831fa7f061de6d7982cb99, UNASSIGN 2023-02-16 18:01:17,864 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=9ec2815f78d2a1df813f1db89d7687e1, UNASSIGN 2023-02-16 18:01:17,864 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=15cb379e20ca93b338be353101a05169, UNASSIGN 2023-02-16 18:01:17,865 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=f8eb7c082b6f65c6ec1c2a7d5837aec5, UNASSIGN 2023-02-16 18:01:17,871 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=3dbbccccab831fa7f061de6d7982cb99, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:17,871 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=9ec2815f78d2a1df813f1db89d7687e1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:17,872 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=15cb379e20ca93b338be353101a05169, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:17,872 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570477871"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570477871"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570477871"}]},"ts":"1676570477871"} 2023-02-16 18:01:17,871 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=510c37f08338dbe42f94233e8f445fad, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:17,872 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676570469835.15cb379e20ca93b338be353101a05169.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570477872"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570477872"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570477872"}]},"ts":"1676570477872"} 2023-02-16 18:01:17,872 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676570477871"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570477871"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570477871"}]},"ts":"1676570477871"} 2023-02-16 18:01:17,872 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=f8eb7c082b6f65c6ec1c2a7d5837aec5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:17,872 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570477872"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570477872"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570477872"}]},"ts":"1676570477872"} 2023-02-16 18:01:17,872 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570477871"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570477871"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570477871"}]},"ts":"1676570477871"} 2023-02-16 18:01:17,874 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=41, state=RUNNABLE; CloseRegionProcedure 9ec2815f78d2a1df813f1db89d7687e1, server=jenkins-hbase4.apache.org,42055,1676570465939}] 2023-02-16 18:01:17,880 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=40, state=RUNNABLE; CloseRegionProcedure 15cb379e20ca93b338be353101a05169, server=jenkins-hbase4.apache.org,42055,1676570465939}] 2023-02-16 18:01:17,881 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; CloseRegionProcedure 3dbbccccab831fa7f061de6d7982cb99, server=jenkins-hbase4.apache.org,43537,1676570465988}] 2023-02-16 18:01:17,882 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=39, state=RUNNABLE; CloseRegionProcedure f8eb7c082b6f65c6ec1c2a7d5837aec5, server=jenkins-hbase4.apache.org,43537,1676570465988}] 2023-02-16 18:01:17,883 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=42, state=RUNNABLE; CloseRegionProcedure 510c37f08338dbe42f94233e8f445fad, server=jenkins-hbase4.apache.org,43537,1676570465988}] 2023-02-16 18:01:17,885 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=70d5f9a2baf8a4ffb3bc7c7c9109edc6, UNASSIGN 2023-02-16 18:01:17,887 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=0bcde8180cee91830f201cd407607b85, UNASSIGN 2023-02-16 18:01:17,887 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=70d5f9a2baf8a4ffb3bc7c7c9109edc6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:17,888 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570477887"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570477887"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570477887"}]},"ts":"1676570477887"} 2023-02-16 18:01:17,888 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=1ec804a87832ac193dda237561459798, UNASSIGN 2023-02-16 18:01:17,888 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=0bcde8180cee91830f201cd407607b85, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:17,889 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676570469835.0bcde8180cee91830f201cd407607b85.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570477888"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570477888"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570477888"}]},"ts":"1676570477888"} 2023-02-16 18:01:17,889 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=1950baaa39bd11f61420d802e58dc470, UNASSIGN 2023-02-16 18:01:17,890 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=1ec804a87832ac193dda237561459798, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:17,891 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676570469835.1ec804a87832ac193dda237561459798.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570477890"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570477890"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570477890"}]},"ts":"1676570477890"} 2023-02-16 18:01:17,891 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=38, state=RUNNABLE; CloseRegionProcedure 70d5f9a2baf8a4ffb3bc7c7c9109edc6, server=jenkins-hbase4.apache.org,42055,1676570465939}] 2023-02-16 18:01:17,891 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=37, state=RUNNABLE; CloseRegionProcedure 0bcde8180cee91830f201cd407607b85, server=jenkins-hbase4.apache.org,43537,1676570465988}] 2023-02-16 18:01:17,892 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=1950baaa39bd11f61420d802e58dc470, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:17,892 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570477892"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570477892"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570477892"}]},"ts":"1676570477892"} 2023-02-16 18:01:17,891 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=a846001b1c0ad7ee601f4b65dccb7fe6, UNASSIGN 2023-02-16 18:01:17,905 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=a846001b1c0ad7ee601f4b65dccb7fe6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:17,905 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676570477905"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570477905"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570477905"}]},"ts":"1676570477905"} 2023-02-16 18:01:17,906 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=36, state=RUNNABLE; CloseRegionProcedure 1ec804a87832ac193dda237561459798, server=jenkins-hbase4.apache.org,42055,1676570465939}] 2023-02-16 18:01:17,907 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=35, state=RUNNABLE; CloseRegionProcedure 1950baaa39bd11f61420d802e58dc470, server=jenkins-hbase4.apache.org,42055,1676570465939}] 2023-02-16 18:01:17,908 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=34, state=RUNNABLE; CloseRegionProcedure a846001b1c0ad7ee601f4b65dccb7fe6, server=jenkins-hbase4.apache.org,43537,1676570465988}] 2023-02-16 18:01:17,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-16 18:01:18,037 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 15cb379e20ca93b338be353101a05169 2023-02-16 18:01:18,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 15cb379e20ca93b338be353101a05169, disabling compactions & flushes 2023-02-16 18:01:18,037 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676570469835.15cb379e20ca93b338be353101a05169. 2023-02-16 18:01:18,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676570469835.15cb379e20ca93b338be353101a05169. 2023-02-16 18:01:18,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676570469835.15cb379e20ca93b338be353101a05169. after waiting 0 ms 2023-02-16 18:01:18,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676570469835.15cb379e20ca93b338be353101a05169. 2023-02-16 18:01:18,037 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close f8eb7c082b6f65c6ec1c2a7d5837aec5 2023-02-16 18:01:18,038 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f8eb7c082b6f65c6ec1c2a7d5837aec5, disabling compactions & flushes 2023-02-16 18:01:18,038 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5. 2023-02-16 18:01:18,038 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5. 2023-02-16 18:01:18,038 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5. after waiting 0 ms 2023-02-16 18:01:18,038 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5. 2023-02-16 18:01:18,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 18:01:18,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 18:01:18,059 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676570469835.15cb379e20ca93b338be353101a05169. 2023-02-16 18:01:18,059 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 15cb379e20ca93b338be353101a05169: 2023-02-16 18:01:18,060 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5. 2023-02-16 18:01:18,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f8eb7c082b6f65c6ec1c2a7d5837aec5: 2023-02-16 18:01:18,062 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 15cb379e20ca93b338be353101a05169 2023-02-16 18:01:18,062 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 70d5f9a2baf8a4ffb3bc7c7c9109edc6 2023-02-16 18:01:18,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 70d5f9a2baf8a4ffb3bc7c7c9109edc6, disabling compactions & flushes 2023-02-16 18:01:18,063 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6. 2023-02-16 18:01:18,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6. 2023-02-16 18:01:18,063 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=15cb379e20ca93b338be353101a05169, regionState=CLOSED 2023-02-16 18:01:18,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6. after waiting 0 ms 2023-02-16 18:01:18,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6. 2023-02-16 18:01:18,063 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676570469835.15cb379e20ca93b338be353101a05169.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570478063"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570478063"}]},"ts":"1676570478063"} 2023-02-16 18:01:18,064 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed f8eb7c082b6f65c6ec1c2a7d5837aec5 2023-02-16 18:01:18,065 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 0bcde8180cee91830f201cd407607b85 2023-02-16 18:01:18,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0bcde8180cee91830f201cd407607b85, disabling compactions & flushes 2023-02-16 18:01:18,065 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85. 2023-02-16 18:01:18,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85. 2023-02-16 18:01:18,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85. after waiting 0 ms 2023-02-16 18:01:18,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85. 2023-02-16 18:01:18,065 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=f8eb7c082b6f65c6ec1c2a7d5837aec5, regionState=CLOSED 2023-02-16 18:01:18,065 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570478065"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570478065"}]},"ts":"1676570478065"} 2023-02-16 18:01:18,068 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=40 2023-02-16 18:01:18,068 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=40, state=SUCCESS; CloseRegionProcedure 15cb379e20ca93b338be353101a05169, server=jenkins-hbase4.apache.org,42055,1676570465939 in 186 msec 2023-02-16 18:01:18,069 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=39 2023-02-16 18:01:18,069 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=39, state=SUCCESS; CloseRegionProcedure f8eb7c082b6f65c6ec1c2a7d5837aec5, server=jenkins-hbase4.apache.org,43537,1676570465988 in 185 msec 2023-02-16 18:01:18,069 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=15cb379e20ca93b338be353101a05169, UNASSIGN in 210 msec 2023-02-16 18:01:18,070 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f8eb7c082b6f65c6ec1c2a7d5837aec5, UNASSIGN in 211 msec 2023-02-16 18:01:18,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 18:01:18,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 18:01:18,089 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6. 2023-02-16 18:01:18,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 70d5f9a2baf8a4ffb3bc7c7c9109edc6: 2023-02-16 18:01:18,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85. 2023-02-16 18:01:18,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0bcde8180cee91830f201cd407607b85: 2023-02-16 18:01:18,092 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 70d5f9a2baf8a4ffb3bc7c7c9109edc6 2023-02-16 18:01:18,092 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 1ec804a87832ac193dda237561459798 2023-02-16 18:01:18,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1ec804a87832ac193dda237561459798, disabling compactions & flushes 2023-02-16 18:01:18,092 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676570469835.1ec804a87832ac193dda237561459798. 2023-02-16 18:01:18,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676570469835.1ec804a87832ac193dda237561459798. 2023-02-16 18:01:18,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676570469835.1ec804a87832ac193dda237561459798. after waiting 0 ms 2023-02-16 18:01:18,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676570469835.1ec804a87832ac193dda237561459798. 2023-02-16 18:01:18,092 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=70d5f9a2baf8a4ffb3bc7c7c9109edc6, regionState=CLOSED 2023-02-16 18:01:18,092 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570478092"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570478092"}]},"ts":"1676570478092"} 2023-02-16 18:01:18,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 0bcde8180cee91830f201cd407607b85 2023-02-16 18:01:18,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 3dbbccccab831fa7f061de6d7982cb99 2023-02-16 18:01:18,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3dbbccccab831fa7f061de6d7982cb99, disabling compactions & flushes 2023-02-16 18:01:18,094 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99. 2023-02-16 18:01:18,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99. 2023-02-16 18:01:18,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99. after waiting 0 ms 2023-02-16 18:01:18,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99. 2023-02-16 18:01:18,094 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=0bcde8180cee91830f201cd407607b85, regionState=CLOSED 2023-02-16 18:01:18,094 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676570469835.0bcde8180cee91830f201cd407607b85.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570478094"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570478094"}]},"ts":"1676570478094"} 2023-02-16 18:01:18,101 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=38 2023-02-16 18:01:18,102 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=38, state=SUCCESS; CloseRegionProcedure 70d5f9a2baf8a4ffb3bc7c7c9109edc6, server=jenkins-hbase4.apache.org,42055,1676570465939 in 207 msec 2023-02-16 18:01:18,102 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=37 2023-02-16 18:01:18,102 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=37, state=SUCCESS; CloseRegionProcedure 0bcde8180cee91830f201cd407607b85, server=jenkins-hbase4.apache.org,43537,1676570465988 in 208 msec 2023-02-16 18:01:18,103 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/3dbbccccab831fa7f061de6d7982cb99/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-16 18:01:18,103 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 18:01:18,104 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99. 2023-02-16 18:01:18,104 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3dbbccccab831fa7f061de6d7982cb99: 2023-02-16 18:01:18,105 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676570469835.1ec804a87832ac193dda237561459798. 2023-02-16 18:01:18,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1ec804a87832ac193dda237561459798: 2023-02-16 18:01:18,106 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=70d5f9a2baf8a4ffb3bc7c7c9109edc6, UNASSIGN in 244 msec 2023-02-16 18:01:18,106 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0bcde8180cee91830f201cd407607b85, UNASSIGN in 244 msec 2023-02-16 18:01:18,107 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 3dbbccccab831fa7f061de6d7982cb99 2023-02-16 18:01:18,107 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 510c37f08338dbe42f94233e8f445fad 2023-02-16 18:01:18,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 510c37f08338dbe42f94233e8f445fad, disabling compactions & flushes 2023-02-16 18:01:18,107 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad. 2023-02-16 18:01:18,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad. 2023-02-16 18:01:18,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad. after waiting 0 ms 2023-02-16 18:01:18,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad. 2023-02-16 18:01:18,107 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=3dbbccccab831fa7f061de6d7982cb99, regionState=CLOSED 2023-02-16 18:01:18,108 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676570478107"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570478107"}]},"ts":"1676570478107"} 2023-02-16 18:01:18,108 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 1ec804a87832ac193dda237561459798 2023-02-16 18:01:18,109 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 1950baaa39bd11f61420d802e58dc470 2023-02-16 18:01:18,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1950baaa39bd11f61420d802e58dc470, disabling compactions & flushes 2023-02-16 18:01:18,109 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470. 2023-02-16 18:01:18,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470. 2023-02-16 18:01:18,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470. after waiting 0 ms 2023-02-16 18:01:18,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470. 2023-02-16 18:01:18,109 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=1ec804a87832ac193dda237561459798, regionState=CLOSED 2023-02-16 18:01:18,109 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676570469835.1ec804a87832ac193dda237561459798.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570478109"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570478109"}]},"ts":"1676570478109"} 2023-02-16 18:01:18,112 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-02-16 18:01:18,112 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; CloseRegionProcedure 3dbbccccab831fa7f061de6d7982cb99, server=jenkins-hbase4.apache.org,43537,1676570465988 in 229 msec 2023-02-16 18:01:18,113 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=36 2023-02-16 18:01:18,113 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=36, state=SUCCESS; CloseRegionProcedure 1ec804a87832ac193dda237561459798, server=jenkins-hbase4.apache.org,42055,1676570465939 in 204 msec 2023-02-16 18:01:18,114 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3dbbccccab831fa7f061de6d7982cb99, UNASSIGN in 252 msec 2023-02-16 18:01:18,115 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=1ec804a87832ac193dda237561459798, UNASSIGN in 255 msec 2023-02-16 18:01:18,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 18:01:18,119 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad. 2023-02-16 18:01:18,119 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 510c37f08338dbe42f94233e8f445fad: 2023-02-16 18:01:18,121 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 510c37f08338dbe42f94233e8f445fad 2023-02-16 18:01:18,121 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close a846001b1c0ad7ee601f4b65dccb7fe6 2023-02-16 18:01:18,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a846001b1c0ad7ee601f4b65dccb7fe6, disabling compactions & flushes 2023-02-16 18:01:18,121 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6. 2023-02-16 18:01:18,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6. 2023-02-16 18:01:18,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6. after waiting 0 ms 2023-02-16 18:01:18,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6. 2023-02-16 18:01:18,121 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=510c37f08338dbe42f94233e8f445fad, regionState=CLOSED 2023-02-16 18:01:18,122 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570478121"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570478121"}]},"ts":"1676570478121"} 2023-02-16 18:01:18,126 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=42 2023-02-16 18:01:18,127 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=42, state=SUCCESS; CloseRegionProcedure 510c37f08338dbe42f94233e8f445fad, server=jenkins-hbase4.apache.org,43537,1676570465988 in 241 msec 2023-02-16 18:01:18,129 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=510c37f08338dbe42f94233e8f445fad, UNASSIGN in 267 msec 2023-02-16 18:01:18,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 18:01:18,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470. 2023-02-16 18:01:18,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1950baaa39bd11f61420d802e58dc470: 2023-02-16 18:01:18,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/a846001b1c0ad7ee601f4b65dccb7fe6/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-16 18:01:18,141 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6. 2023-02-16 18:01:18,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a846001b1c0ad7ee601f4b65dccb7fe6: 2023-02-16 18:01:18,141 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 1950baaa39bd11f61420d802e58dc470 2023-02-16 18:01:18,141 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 9ec2815f78d2a1df813f1db89d7687e1 2023-02-16 18:01:18,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9ec2815f78d2a1df813f1db89d7687e1, disabling compactions & flushes 2023-02-16 18:01:18,142 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1. 2023-02-16 18:01:18,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1. 2023-02-16 18:01:18,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1. after waiting 0 ms 2023-02-16 18:01:18,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1. 2023-02-16 18:01:18,142 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=1950baaa39bd11f61420d802e58dc470, regionState=CLOSED 2023-02-16 18:01:18,142 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570478142"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570478142"}]},"ts":"1676570478142"} 2023-02-16 18:01:18,143 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed a846001b1c0ad7ee601f4b65dccb7fe6 2023-02-16 18:01:18,145 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=a846001b1c0ad7ee601f4b65dccb7fe6, regionState=CLOSED 2023-02-16 18:01:18,145 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676570478145"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570478145"}]},"ts":"1676570478145"} 2023-02-16 18:01:18,149 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=35 2023-02-16 18:01:18,149 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=35, state=SUCCESS; CloseRegionProcedure 1950baaa39bd11f61420d802e58dc470, server=jenkins-hbase4.apache.org,42055,1676570465939 in 238 msec 2023-02-16 18:01:18,150 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=34 2023-02-16 18:01:18,150 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=34, state=SUCCESS; CloseRegionProcedure a846001b1c0ad7ee601f4b65dccb7fe6, server=jenkins-hbase4.apache.org,43537,1676570465988 in 239 msec 2023-02-16 18:01:18,151 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=1950baaa39bd11f61420d802e58dc470, UNASSIGN in 291 msec 2023-02-16 18:01:18,152 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a846001b1c0ad7ee601f4b65dccb7fe6, UNASSIGN in 292 msec 2023-02-16 18:01:18,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-16 18:01:18,162 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 18:01:18,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1. 2023-02-16 18:01:18,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9ec2815f78d2a1df813f1db89d7687e1: 2023-02-16 18:01:18,167 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=9ec2815f78d2a1df813f1db89d7687e1, regionState=CLOSED 2023-02-16 18:01:18,167 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570478167"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570478167"}]},"ts":"1676570478167"} 2023-02-16 18:01:18,167 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 9ec2815f78d2a1df813f1db89d7687e1 2023-02-16 18:01:18,178 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=41 2023-02-16 18:01:18,178 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=41, state=SUCCESS; CloseRegionProcedure 9ec2815f78d2a1df813f1db89d7687e1, server=jenkins-hbase4.apache.org,42055,1676570465939 in 295 msec 2023-02-16 18:01:18,186 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=33 2023-02-16 18:01:18,186 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9ec2815f78d2a1df813f1db89d7687e1, UNASSIGN in 320 msec 2023-02-16 18:01:18,187 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676570478187"}]},"ts":"1676570478187"} 2023-02-16 18:01:18,193 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-16 18:01:18,198 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-16 18:01:18,200 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 357 msec 2023-02-16 18:01:18,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-16 18:01:18,460 INFO [Listener at localhost/45407] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-16 18:01:18,465 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-16 18:01:18,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-16 18:01:18,476 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 18:01:18,478 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 18:01:18,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-16 18:01:18,494 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/a846001b1c0ad7ee601f4b65dccb7fe6 2023-02-16 18:01:18,494 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470 2023-02-16 18:01:18,494 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85 2023-02-16 18:01:18,494 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5 2023-02-16 18:01:18,494 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1 2023-02-16 18:01:18,494 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6 2023-02-16 18:01:18,494 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798 2023-02-16 18:01:18,494 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169 2023-02-16 18:01:18,500 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/f1, FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/f2, FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/recovered.edits] 2023-02-16 18:01:18,500 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/a846001b1c0ad7ee601f4b65dccb7fe6/f1, FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/a846001b1c0ad7ee601f4b65dccb7fe6/f2, FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/a846001b1c0ad7ee601f4b65dccb7fe6/recovered.edits] 2023-02-16 18:01:18,501 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/f1, FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/f2, FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/recovered.edits] 2023-02-16 18:01:18,501 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/f1, FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/f2, FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/recovered.edits] 2023-02-16 18:01:18,501 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/f1, FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/f2, FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/recovered.edits] 2023-02-16 18:01:18,502 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/f1, FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/f2, FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/recovered.edits] 2023-02-16 18:01:18,502 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/f1, FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/f2, FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/recovered.edits] 2023-02-16 18:01:18,503 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/f1, FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/f2, FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/recovered.edits] 2023-02-16 18:01:18,515 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/f1/99c7c9c45c074ad19f949b3adb98b608 to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/f1/99c7c9c45c074ad19f949b3adb98b608 2023-02-16 18:01:18,516 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/f1/2a4866627cc44f41abf8dd70e7d5a480 to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/f1/2a4866627cc44f41abf8dd70e7d5a480 2023-02-16 18:01:18,516 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/f1/13c59ae4248a4ca08ed5969f2f265224 to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/f1/13c59ae4248a4ca08ed5969f2f265224 2023-02-16 18:01:18,516 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/f1/da8175262809406788816c2b6b549d9f to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/f1/da8175262809406788816c2b6b549d9f 2023-02-16 18:01:18,517 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/f1/a816115d084d4f2aaa4ef24122c272c4 to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/f1/a816115d084d4f2aaa4ef24122c272c4 2023-02-16 18:01:18,517 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/f1/4c269342aa394e2287c00de41965d981 to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/f1/4c269342aa394e2287c00de41965d981 2023-02-16 18:01:18,521 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/f1/ea201ddc2acb4beea02f5ab7490bcc70 to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/f1/ea201ddc2acb4beea02f5ab7490bcc70 2023-02-16 18:01:18,521 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/f1/e04b273e45b14c558f2ac08e86a9d418 to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/f1/e04b273e45b14c558f2ac08e86a9d418 2023-02-16 18:01:18,522 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/f1/204fbfa5464a4ec0aaca1bd1ad488b92 to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/f1/204fbfa5464a4ec0aaca1bd1ad488b92 2023-02-16 18:01:18,523 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/f1/9871aa5eded748c584a4e9d331cb2ce7 to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/f1/9871aa5eded748c584a4e9d331cb2ce7 2023-02-16 18:01:18,524 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/f1/2ed331b01f2c4545bae6b867845197b0 to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/f1/2ed331b01f2c4545bae6b867845197b0 2023-02-16 18:01:18,525 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/f1/aeb6d2e136844d0ebb9fdc1c492e2673 to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/f1/aeb6d2e136844d0ebb9fdc1c492e2673 2023-02-16 18:01:18,525 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/a846001b1c0ad7ee601f4b65dccb7fe6/recovered.edits/6.seqid to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/a846001b1c0ad7ee601f4b65dccb7fe6/recovered.edits/6.seqid 2023-02-16 18:01:18,525 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/f1/8e5dd9db82bb46c3ad72a90523122283 to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/f1/8e5dd9db82bb46c3ad72a90523122283 2023-02-16 18:01:18,526 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/a846001b1c0ad7ee601f4b65dccb7fe6 2023-02-16 18:01:18,526 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad 2023-02-16 18:01:18,528 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/f1/a8c612f4b521465bb3844c1ccded1cf5 to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/f1/a8c612f4b521465bb3844c1ccded1cf5 2023-02-16 18:01:18,532 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/f2/35645d4df7f9473bb5557617b6dcb790 to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/f2/35645d4df7f9473bb5557617b6dcb790 2023-02-16 18:01:18,533 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/f1, FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/f2, FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/recovered.edits] 2023-02-16 18:01:18,534 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/f2/05b04ac95e15495cbaf2060b19ae176d to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/f2/05b04ac95e15495cbaf2060b19ae176d 2023-02-16 18:01:18,535 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/f2/1218918a7c044d92b88a04b6b9585acc to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/f2/1218918a7c044d92b88a04b6b9585acc 2023-02-16 18:01:18,535 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/f2/ba96f74b4eaf479a8ae083636dc880a9 to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/f2/ba96f74b4eaf479a8ae083636dc880a9 2023-02-16 18:01:18,535 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/f2/24ed7afa71c44155857c43d62d2ebf58 to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/f2/24ed7afa71c44155857c43d62d2ebf58 2023-02-16 18:01:18,536 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/f2/b262d0351a424eea8629cb50735c515a to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/f2/b262d0351a424eea8629cb50735c515a 2023-02-16 18:01:18,538 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/f2/eceec544f1524b37b04b78ed9bb32f76 to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/f2/eceec544f1524b37b04b78ed9bb32f76 2023-02-16 18:01:18,539 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/f2/7c7727dd1040490c9d469574d2766a2c to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/f2/7c7727dd1040490c9d469574d2766a2c 2023-02-16 18:01:18,539 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/f2/4fb6a582b5eb454aabca1e34f68c8479 to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/f2/4fb6a582b5eb454aabca1e34f68c8479 2023-02-16 18:01:18,540 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/f2/7c11ef3f33014f029b5c94ccb3d93d51 to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/f2/7c11ef3f33014f029b5c94ccb3d93d51 2023-02-16 18:01:18,540 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/f2/f58aa8e89f3b4abdab7a2cf601725911 to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/f2/f58aa8e89f3b4abdab7a2cf601725911 2023-02-16 18:01:18,541 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/f2/7a87b5e6ff4d45b397db7bab5ca935e3 to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/f2/7a87b5e6ff4d45b397db7bab5ca935e3 2023-02-16 18:01:18,541 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/f2/b7aa608521aa45559d3ec7d95c0ce795 to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/f2/b7aa608521aa45559d3ec7d95c0ce795 2023-02-16 18:01:18,547 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/f1/6fcfe3ef087543e4a7b9c0c4f83050a3 to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/f1/6fcfe3ef087543e4a7b9c0c4f83050a3 2023-02-16 18:01:18,547 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/f2/836d70dd55074a8d83bbba7ce7f219ce to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/f2/836d70dd55074a8d83bbba7ce7f219ce 2023-02-16 18:01:18,550 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/recovered.edits/12.seqid to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798/recovered.edits/12.seqid 2023-02-16 18:01:18,550 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/recovered.edits/12.seqid to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1/recovered.edits/12.seqid 2023-02-16 18:01:18,550 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/recovered.edits/12.seqid to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85/recovered.edits/12.seqid 2023-02-16 18:01:18,551 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/recovered.edits/12.seqid to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5/recovered.edits/12.seqid 2023-02-16 18:01:18,551 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/1ec804a87832ac193dda237561459798 2023-02-16 18:01:18,551 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/3dbbccccab831fa7f061de6d7982cb99 2023-02-16 18:01:18,551 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/recovered.edits/12.seqid to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169/recovered.edits/12.seqid 2023-02-16 18:01:18,552 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/recovered.edits/12.seqid to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6/recovered.edits/12.seqid 2023-02-16 18:01:18,552 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/f1/e9a7b963fbb3485e967d605bc1ce016a to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/f1/e9a7b963fbb3485e967d605bc1ce016a 2023-02-16 18:01:18,552 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/9ec2815f78d2a1df813f1db89d7687e1 2023-02-16 18:01:18,553 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/0bcde8180cee91830f201cd407607b85 2023-02-16 18:01:18,553 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/f8eb7c082b6f65c6ec1c2a7d5837aec5 2023-02-16 18:01:18,553 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/15cb379e20ca93b338be353101a05169 2023-02-16 18:01:18,559 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/70d5f9a2baf8a4ffb3bc7c7c9109edc6 2023-02-16 18:01:18,561 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/3dbbccccab831fa7f061de6d7982cb99/f1, FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/3dbbccccab831fa7f061de6d7982cb99/f2, FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/3dbbccccab831fa7f061de6d7982cb99/recovered.edits] 2023-02-16 18:01:18,563 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/recovered.edits/12.seqid to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470/recovered.edits/12.seqid 2023-02-16 18:01:18,563 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/1950baaa39bd11f61420d802e58dc470 2023-02-16 18:01:18,564 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/f2/2812262f89274514a56f3872f0ad6017 to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/f2/2812262f89274514a56f3872f0ad6017 2023-02-16 18:01:18,566 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/f2/3a5e3b66285c4905b7489252b05455e4 to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/f2/3a5e3b66285c4905b7489252b05455e4 2023-02-16 18:01:18,569 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/3dbbccccab831fa7f061de6d7982cb99/recovered.edits/6.seqid to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/3dbbccccab831fa7f061de6d7982cb99/recovered.edits/6.seqid 2023-02-16 18:01:18,569 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/recovered.edits/12.seqid to hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/archive/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad/recovered.edits/12.seqid 2023-02-16 18:01:18,570 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/3dbbccccab831fa7f061de6d7982cb99 2023-02-16 18:01:18,570 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/.tmp/data/default/testWithMapReduce/510c37f08338dbe42f94233e8f445fad 2023-02-16 18:01:18,570 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-16 18:01:18,573 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 18:01:18,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-16 18:01:18,595 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-16 18:01:18,599 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-16 18:01:18,600 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 18:01:18,600 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-16 18:01:18,601 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676570478601"}]},"ts":"9223372036854775807"} 2023-02-16 18:01:18,601 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676570478601"}]},"ts":"9223372036854775807"} 2023-02-16 18:01:18,601 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1676570469835.1ec804a87832ac193dda237561459798.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676570478601"}]},"ts":"9223372036854775807"} 2023-02-16 18:01:18,601 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1676570469835.0bcde8180cee91830f201cd407607b85.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676570478601"}]},"ts":"9223372036854775807"} 2023-02-16 18:01:18,601 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676570478601"}]},"ts":"9223372036854775807"} 2023-02-16 18:01:18,601 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676570478601"}]},"ts":"9223372036854775807"} 2023-02-16 18:01:18,601 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1676570469835.15cb379e20ca93b338be353101a05169.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676570478601"}]},"ts":"9223372036854775807"} 2023-02-16 18:01:18,601 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676570478601"}]},"ts":"9223372036854775807"} 2023-02-16 18:01:18,601 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676570478601"}]},"ts":"9223372036854775807"} 2023-02-16 18:01:18,601 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676570478601"}]},"ts":"9223372036854775807"} 2023-02-16 18:01:18,603 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-16 18:01:18,603 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a846001b1c0ad7ee601f4b65dccb7fe6, NAME => 'testWithMapReduce,,1676570469835.a846001b1c0ad7ee601f4b65dccb7fe6.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 1950baaa39bd11f61420d802e58dc470, NAME => 'testWithMapReduce,aaa,1676570469835.1950baaa39bd11f61420d802e58dc470.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 1ec804a87832ac193dda237561459798, NAME => 'testWithMapReduce,d\x84\x84,1676570469835.1ec804a87832ac193dda237561459798.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 0bcde8180cee91830f201cd407607b85, NAME => 'testWithMapReduce,g\xA7\xA7,1676570469835.0bcde8180cee91830f201cd407607b85.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 70d5f9a2baf8a4ffb3bc7c7c9109edc6, NAME => 'testWithMapReduce,j\xCA\xCA,1676570469835.70d5f9a2baf8a4ffb3bc7c7c9109edc6.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => f8eb7c082b6f65c6ec1c2a7d5837aec5, NAME => 'testWithMapReduce,m\xED\xED,1676570469835.f8eb7c082b6f65c6ec1c2a7d5837aec5.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 15cb379e20ca93b338be353101a05169, NAME => 'testWithMapReduce,q\x11\x10,1676570469835.15cb379e20ca93b338be353101a05169.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 9ec2815f78d2a1df813f1db89d7687e1, NAME => 'testWithMapReduce,t43,1676570469835.9ec2815f78d2a1df813f1db89d7687e1.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 510c37f08338dbe42f94233e8f445fad, NAME => 'testWithMapReduce,wWV,1676570469835.510c37f08338dbe42f94233e8f445fad.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 3dbbccccab831fa7f061de6d7982cb99, NAME => 'testWithMapReduce,zz{,1676570469835.3dbbccccab831fa7f061de6d7982cb99.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-16 18:01:18,603 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-16 18:01:18,604 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676570478603"}]},"ts":"9223372036854775807"} 2023-02-16 18:01:18,605 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-16 18:01:18,607 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 18:01:18,608 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 140 msec 2023-02-16 18:01:18,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43805] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-16 18:01:18,783 INFO [Listener at localhost/45407] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-16 18:01:18,783 INFO [Listener at localhost/45407] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-16 18:01:18,783 INFO [Listener at localhost/45407] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-16 18:01:18,783 DEBUG [Listener at localhost/45407] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x01e264eb to 127.0.0.1:59495 2023-02-16 18:01:18,783 DEBUG [Listener at localhost/45407] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:18,783 DEBUG [Listener at localhost/45407] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-16 18:01:18,783 DEBUG [Listener at localhost/45407] util.JVMClusterUtil(257): Found active master hash=1442427575, stopped=false 2023-02-16 18:01:18,783 INFO [Listener at localhost/45407] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,43805,1676570464786 2023-02-16 18:01:18,790 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): regionserver:42055-0x1005e4af84e0001, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:18,790 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:18,790 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): regionserver:43537-0x1005e4af84e0002, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:18,790 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:18,791 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42055-0x1005e4af84e0001, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:18,791 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:18,791 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43537-0x1005e4af84e0002, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:18,791 INFO [Listener at localhost/45407] procedure2.ProcedureExecutor(629): Stopping 2023-02-16 18:01:18,797 DEBUG [Listener at localhost/45407] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x32276ff2 to 127.0.0.1:59495 2023-02-16 18:01:18,797 DEBUG [Listener at localhost/45407] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:18,798 INFO [Listener at localhost/45407] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42055,1676570465939' ***** 2023-02-16 18:01:18,798 INFO [Listener at localhost/45407] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 18:01:18,798 INFO [Listener at localhost/45407] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43537,1676570465988' ***** 2023-02-16 18:01:18,798 INFO [Listener at localhost/45407] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 18:01:18,799 INFO [RS:1;jenkins-hbase4:43537] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 18:01:18,799 INFO [RS:1;jenkins-hbase4:43537] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 18:01:18,799 INFO [RS:1;jenkins-hbase4:43537] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 18:01:18,799 INFO [RS:1;jenkins-hbase4:43537] regionserver.HRegionServer(3304): Received CLOSE for 8b1312fe059e27b3414b8b45528213c8 2023-02-16 18:01:18,799 INFO [RS:1;jenkins-hbase4:43537] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:18,799 DEBUG [RS:1;jenkins-hbase4:43537] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6303061c to 127.0.0.1:59495 2023-02-16 18:01:18,799 DEBUG [RS:1;jenkins-hbase4:43537] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:18,799 INFO [RS:1;jenkins-hbase4:43537] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 18:01:18,799 INFO [RS:1;jenkins-hbase4:43537] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 18:01:18,800 INFO [RS:1;jenkins-hbase4:43537] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 18:01:18,800 INFO [RS:1;jenkins-hbase4:43537] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-16 18:01:18,800 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 18:01:18,798 INFO [RS:0;jenkins-hbase4:42055] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 18:01:18,800 INFO [RS:1;jenkins-hbase4:43537] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-16 18:01:18,800 DEBUG [RS:1;jenkins-hbase4:43537] regionserver.HRegionServer(1479): Online Regions={8b1312fe059e27b3414b8b45528213c8=hbase:namespace,,1676570468955.8b1312fe059e27b3414b8b45528213c8., 1588230740=hbase:meta,,1.1588230740} 2023-02-16 18:01:18,801 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 18:01:18,801 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 18:01:18,801 INFO [RS:0;jenkins-hbase4:42055] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 18:01:18,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8b1312fe059e27b3414b8b45528213c8, disabling compactions & flushes 2023-02-16 18:01:18,804 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676570468955.8b1312fe059e27b3414b8b45528213c8. 2023-02-16 18:01:18,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676570468955.8b1312fe059e27b3414b8b45528213c8. 2023-02-16 18:01:18,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676570468955.8b1312fe059e27b3414b8b45528213c8. after waiting 0 ms 2023-02-16 18:01:18,804 INFO [RS:0;jenkins-hbase4:42055] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 18:01:18,803 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 18:01:18,804 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 18:01:18,804 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 18:01:18,804 INFO [RS:0;jenkins-hbase4:42055] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:18,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676570468955.8b1312fe059e27b3414b8b45528213c8. 2023-02-16 18:01:18,804 DEBUG [RS:0;jenkins-hbase4:42055] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7cf3be3c to 127.0.0.1:59495 2023-02-16 18:01:18,804 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 8b1312fe059e27b3414b8b45528213c8 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-16 18:01:18,804 DEBUG [RS:0;jenkins-hbase4:42055] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:18,804 INFO [RS:0;jenkins-hbase4:42055] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42055,1676570465939; all regions closed. 2023-02-16 18:01:18,804 DEBUG [RS:1;jenkins-hbase4:43537] regionserver.HRegionServer(1505): Waiting on 1588230740, 8b1312fe059e27b3414b8b45528213c8 2023-02-16 18:01:18,804 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 18:01:18,805 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.29 KB heapSize=40.20 KB 2023-02-16 18:01:18,834 DEBUG [RS:0;jenkins-hbase4:42055] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/oldWALs 2023-02-16 18:01:18,834 INFO [RS:0;jenkins-hbase4:42055] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42055%2C1676570465939:(num 1676570469396) 2023-02-16 18:01:18,834 DEBUG [RS:0;jenkins-hbase4:42055] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:18,834 INFO [RS:0;jenkins-hbase4:42055] regionserver.LeaseManager(133): Closed leases 2023-02-16 18:01:18,840 INFO [RS:0;jenkins-hbase4:42055] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-16 18:01:18,840 INFO [RS:0;jenkins-hbase4:42055] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 18:01:18,841 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 18:01:18,841 INFO [RS:0;jenkins-hbase4:42055] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 18:01:18,841 INFO [RS:0;jenkins-hbase4:42055] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 18:01:18,842 INFO [RS:0;jenkins-hbase4:42055] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42055 2023-02-16 18:01:18,854 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/hbase/namespace/8b1312fe059e27b3414b8b45528213c8/.tmp/info/4c095b9373e245d0bd54a7f1f9d20a08 2023-02-16 18:01:18,861 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 18:01:18,861 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 18:01:18,877 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:18,877 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): regionserver:43537-0x1005e4af84e0002, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:18,877 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): regionserver:43537-0x1005e4af84e0002, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:18,877 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): regionserver:42055-0x1005e4af84e0001, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42055,1676570465939 2023-02-16 18:01:18,882 ERROR [Listener at localhost/45407-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6adf82dc rejected from java.util.concurrent.ThreadPoolExecutor@6ee01b5f[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:18,882 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): regionserver:42055-0x1005e4af84e0001, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:18,882 ERROR [Listener at localhost/45407-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@cdc0cbc rejected from java.util.concurrent.ThreadPoolExecutor@6ee01b5f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:18,887 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42055,1676570465939] 2023-02-16 18:01:18,887 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42055,1676570465939; numProcessing=1 2023-02-16 18:01:18,890 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42055,1676570465939 already deleted, retry=false 2023-02-16 18:01:18,890 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42055,1676570465939 expired; onlineServers=1 2023-02-16 18:01:18,890 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.08 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/hbase/meta/1588230740/.tmp/info/286ccc22f954454faa9061e96d2ae018 2023-02-16 18:01:18,894 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/hbase/namespace/8b1312fe059e27b3414b8b45528213c8/.tmp/info/4c095b9373e245d0bd54a7f1f9d20a08 as hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/hbase/namespace/8b1312fe059e27b3414b8b45528213c8/info/4c095b9373e245d0bd54a7f1f9d20a08 2023-02-16 18:01:18,909 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 286ccc22f954454faa9061e96d2ae018 2023-02-16 18:01:18,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/hbase/namespace/8b1312fe059e27b3414b8b45528213c8/info/4c095b9373e245d0bd54a7f1f9d20a08, entries=2, sequenceid=6, filesize=4.8 K 2023-02-16 18:01:18,917 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 8b1312fe059e27b3414b8b45528213c8 in 112ms, sequenceid=6, compaction requested=false 2023-02-16 18:01:18,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/hbase/namespace/8b1312fe059e27b3414b8b45528213c8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-16 18:01:18,949 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676570468955.8b1312fe059e27b3414b8b45528213c8. 2023-02-16 18:01:18,949 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8b1312fe059e27b3414b8b45528213c8: 2023-02-16 18:01:18,949 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676570468955.8b1312fe059e27b3414b8b45528213c8. 2023-02-16 18:01:18,954 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/hbase/meta/1588230740/.tmp/rep_barrier/6d25ab24a25a483f83a2a52f9bd46fd5 2023-02-16 18:01:18,961 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6d25ab24a25a483f83a2a52f9bd46fd5 2023-02-16 18:01:18,983 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/hbase/meta/1588230740/.tmp/table/115411001395451a8c270262e80dfed8 2023-02-16 18:01:18,990 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 115411001395451a8c270262e80dfed8 2023-02-16 18:01:18,991 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/hbase/meta/1588230740/.tmp/info/286ccc22f954454faa9061e96d2ae018 as hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/hbase/meta/1588230740/info/286ccc22f954454faa9061e96d2ae018 2023-02-16 18:01:18,998 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 286ccc22f954454faa9061e96d2ae018 2023-02-16 18:01:18,998 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/hbase/meta/1588230740/info/286ccc22f954454faa9061e96d2ae018, entries=30, sequenceid=57, filesize=7.9 K 2023-02-16 18:01:18,999 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/hbase/meta/1588230740/.tmp/rep_barrier/6d25ab24a25a483f83a2a52f9bd46fd5 as hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/hbase/meta/1588230740/rep_barrier/6d25ab24a25a483f83a2a52f9bd46fd5 2023-02-16 18:01:19,005 DEBUG [RS:1;jenkins-hbase4:43537] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-16 18:01:19,006 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6d25ab24a25a483f83a2a52f9bd46fd5 2023-02-16 18:01:19,006 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/hbase/meta/1588230740/rep_barrier/6d25ab24a25a483f83a2a52f9bd46fd5, entries=10, sequenceid=57, filesize=5.9 K 2023-02-16 18:01:19,007 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/hbase/meta/1588230740/.tmp/table/115411001395451a8c270262e80dfed8 as hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/hbase/meta/1588230740/table/115411001395451a8c270262e80dfed8 2023-02-16 18:01:19,014 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 115411001395451a8c270262e80dfed8 2023-02-16 18:01:19,014 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/hbase/meta/1588230740/table/115411001395451a8c270262e80dfed8, entries=13, sequenceid=57, filesize=5.9 K 2023-02-16 18:01:19,016 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 211ms, sequenceid=57, compaction requested=false 2023-02-16 18:01:19,035 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-16 18:01:19,036 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 18:01:19,037 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 18:01:19,037 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 18:01:19,037 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-16 18:01:19,205 INFO [RS:1;jenkins-hbase4:43537] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43537,1676570465988; all regions closed. 2023-02-16 18:01:19,212 DEBUG [RS:1;jenkins-hbase4:43537] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/oldWALs 2023-02-16 18:01:19,212 INFO [RS:1;jenkins-hbase4:43537] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43537%2C1676570465988.meta:.meta(num 1676570468700) 2023-02-16 18:01:19,222 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/WALs/jenkins-hbase4.apache.org,43537,1676570465988/jenkins-hbase4.apache.org%2C43537%2C1676570465988.1676570469396 not finished, retry = 0 2023-02-16 18:01:19,290 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): regionserver:42055-0x1005e4af84e0001, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:19,290 INFO [RS:0;jenkins-hbase4:42055] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42055,1676570465939; zookeeper connection closed. 2023-02-16 18:01:19,290 ERROR [Listener at localhost/45407-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@74d77c65 rejected from java.util.concurrent.ThreadPoolExecutor@6ee01b5f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:19,290 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4dc15e4b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4dc15e4b 2023-02-16 18:01:19,290 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): regionserver:42055-0x1005e4af84e0001, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:19,290 ERROR [Listener at localhost/45407-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@27982b81 rejected from java.util.concurrent.ThreadPoolExecutor@6ee01b5f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:19,325 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-16 18:01:19,325 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-16 18:01:19,326 DEBUG [RS:1;jenkins-hbase4:43537] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/oldWALs 2023-02-16 18:01:19,326 INFO [RS:1;jenkins-hbase4:43537] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43537%2C1676570465988:(num 1676570469396) 2023-02-16 18:01:19,326 DEBUG [RS:1;jenkins-hbase4:43537] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:19,326 INFO [RS:1;jenkins-hbase4:43537] regionserver.LeaseManager(133): Closed leases 2023-02-16 18:01:19,326 INFO [RS:1;jenkins-hbase4:43537] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-16 18:01:19,327 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 18:01:19,328 INFO [RS:1;jenkins-hbase4:43537] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43537 2023-02-16 18:01:19,331 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): regionserver:43537-0x1005e4af84e0002, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43537,1676570465988 2023-02-16 18:01:19,331 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:19,332 ERROR [Listener at localhost/45407-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@20c5d579 rejected from java.util.concurrent.ThreadPoolExecutor@24fa45b9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:19,333 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43537,1676570465988] 2023-02-16 18:01:19,333 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43537,1676570465988; numProcessing=2 2023-02-16 18:01:19,335 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43537,1676570465988 already deleted, retry=false 2023-02-16 18:01:19,335 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43537,1676570465988 expired; onlineServers=0 2023-02-16 18:01:19,335 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43805,1676570464786' ***** 2023-02-16 18:01:19,335 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-16 18:01:19,335 DEBUG [M:0;jenkins-hbase4:43805] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14c4b88c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 18:01:19,335 INFO [M:0;jenkins-hbase4:43805] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43805,1676570464786 2023-02-16 18:01:19,335 INFO [M:0;jenkins-hbase4:43805] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43805,1676570464786; all regions closed. 2023-02-16 18:01:19,335 DEBUG [M:0;jenkins-hbase4:43805] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:19,336 DEBUG [M:0;jenkins-hbase4:43805] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-16 18:01:19,336 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-16 18:01:19,336 DEBUG [M:0;jenkins-hbase4:43805] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-16 18:01:19,336 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676570467205] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676570467205,5,FailOnTimeoutGroup] 2023-02-16 18:01:19,336 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676570467204] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676570467204,5,FailOnTimeoutGroup] 2023-02-16 18:01:19,338 INFO [M:0;jenkins-hbase4:43805] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-16 18:01:19,338 INFO [M:0;jenkins-hbase4:43805] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-16 18:01:19,338 INFO [M:0;jenkins-hbase4:43805] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-16 18:01:19,338 DEBUG [M:0;jenkins-hbase4:43805] master.HMaster(1512): Stopping service threads 2023-02-16 18:01:19,338 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-16 18:01:19,338 INFO [M:0;jenkins-hbase4:43805] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-16 18:01:19,338 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:19,338 ERROR [M:0;jenkins-hbase4:43805] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-16 18:01:19,339 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 18:01:19,339 INFO [M:0;jenkins-hbase4:43805] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-16 18:01:19,339 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-16 18:01:19,340 DEBUG [M:0;jenkins-hbase4:43805] zookeeper.ZKUtil(398): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-16 18:01:19,340 WARN [M:0;jenkins-hbase4:43805] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-16 18:01:19,340 INFO [M:0;jenkins-hbase4:43805] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-16 18:01:19,341 INFO [M:0;jenkins-hbase4:43805] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-16 18:01:19,341 DEBUG [M:0;jenkins-hbase4:43805] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 18:01:19,341 INFO [M:0;jenkins-hbase4:43805] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:19,341 DEBUG [M:0;jenkins-hbase4:43805] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:19,342 DEBUG [M:0;jenkins-hbase4:43805] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 18:01:19,342 DEBUG [M:0;jenkins-hbase4:43805] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:19,342 INFO [M:0;jenkins-hbase4:43805] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=159.25 KB heapSize=192.19 KB 2023-02-16 18:01:19,397 INFO [M:0;jenkins-hbase4:43805] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=159.25 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b817793693e6462d88ba46b60c608220 2023-02-16 18:01:19,402 DEBUG [M:0;jenkins-hbase4:43805] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b817793693e6462d88ba46b60c608220 as hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b817793693e6462d88ba46b60c608220 2023-02-16 18:01:19,407 INFO [M:0;jenkins-hbase4:43805] regionserver.HStore(1080): Added hdfs://localhost:43129/user/jenkins/test-data/a911842a-7236-9733-a0f2-aa0f81c90d93/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b817793693e6462d88ba46b60c608220, entries=53, sequenceid=357, filesize=10.4 K 2023-02-16 18:01:19,409 INFO [M:0;jenkins-hbase4:43805] regionserver.HRegion(2947): Finished flush of dataSize ~159.25 KB/163075, heapSize ~192.17 KB/196784, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 67ms, sequenceid=357, compaction requested=false 2023-02-16 18:01:19,413 INFO [M:0;jenkins-hbase4:43805] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:19,413 DEBUG [M:0;jenkins-hbase4:43805] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 18:01:19,417 INFO [M:0;jenkins-hbase4:43805] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-16 18:01:19,417 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 18:01:19,418 INFO [M:0;jenkins-hbase4:43805] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43805 2023-02-16 18:01:19,420 DEBUG [M:0;jenkins-hbase4:43805] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,43805,1676570464786 already deleted, retry=false 2023-02-16 18:01:19,433 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): regionserver:43537-0x1005e4af84e0002, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:19,433 INFO [RS:1;jenkins-hbase4:43537] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43537,1676570465988; zookeeper connection closed. 2023-02-16 18:01:19,433 ERROR [Listener at localhost/45407-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5eb3d1d2 rejected from java.util.concurrent.ThreadPoolExecutor@24fa45b9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:19,433 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7520f46] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7520f46 2023-02-16 18:01:19,433 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): regionserver:43537-0x1005e4af84e0002, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:19,433 ERROR [Listener at localhost/45407-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@26f2e95e rejected from java.util.concurrent.ThreadPoolExecutor@24fa45b9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:19,434 INFO [Listener at localhost/45407] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-16 18:01:19,533 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:19,533 INFO [M:0;jenkins-hbase4:43805] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43805,1676570464786; zookeeper connection closed. 2023-02-16 18:01:19,533 ERROR [Listener at localhost/45407-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6341d136 rejected from java.util.concurrent.ThreadPoolExecutor@2d1a4101[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:19,534 DEBUG [Listener at localhost/45407-EventThread] zookeeper.ZKWatcher(600): master:43805-0x1005e4af84e0000, quorum=127.0.0.1:59495, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:19,534 ERROR [Listener at localhost/45407-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2456b155 rejected from java.util.concurrent.ThreadPoolExecutor@2d1a4101[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:19,536 WARN [Listener at localhost/45407] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 18:01:19,549 INFO [Listener at localhost/45407] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 18:01:19,653 WARN [BP-1774480411-172.31.14.131-1676570461472 heartbeating to localhost/127.0.0.1:43129] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 18:01:19,653 WARN [BP-1774480411-172.31.14.131-1676570461472 heartbeating to localhost/127.0.0.1:43129] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1774480411-172.31.14.131-1676570461472 (Datanode Uuid 9e43cf49-f612-45ae-b3de-ab03ad62222f) service to localhost/127.0.0.1:43129 2023-02-16 18:01:19,655 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9c71488a-f642-9649-d836-a74163cd870e/cluster_e516932b-80c4-8478-eabc-743e1d98ecd3/dfs/data/data3/current/BP-1774480411-172.31.14.131-1676570461472] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 18:01:19,655 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9c71488a-f642-9649-d836-a74163cd870e/cluster_e516932b-80c4-8478-eabc-743e1d98ecd3/dfs/data/data4/current/BP-1774480411-172.31.14.131-1676570461472] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 18:01:19,657 WARN [Listener at localhost/45407] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 18:01:19,660 INFO [Listener at localhost/45407] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 18:01:19,764 WARN [BP-1774480411-172.31.14.131-1676570461472 heartbeating to localhost/127.0.0.1:43129] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 18:01:19,764 WARN [BP-1774480411-172.31.14.131-1676570461472 heartbeating to localhost/127.0.0.1:43129] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1774480411-172.31.14.131-1676570461472 (Datanode Uuid 428e4d18-92a4-4153-b2ab-b35fd0af60f4) service to localhost/127.0.0.1:43129 2023-02-16 18:01:19,765 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9c71488a-f642-9649-d836-a74163cd870e/cluster_e516932b-80c4-8478-eabc-743e1d98ecd3/dfs/data/data1/current/BP-1774480411-172.31.14.131-1676570461472] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 18:01:19,765 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9c71488a-f642-9649-d836-a74163cd870e/cluster_e516932b-80c4-8478-eabc-743e1d98ecd3/dfs/data/data2/current/BP-1774480411-172.31.14.131-1676570461472] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 18:01:19,800 INFO [Listener at localhost/45407] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 18:01:19,921 INFO [Listener at localhost/45407] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-16 18:01:19,988 INFO [Listener at localhost/45407] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-16 18:01:20,002 INFO [Listener at localhost/45407] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=103 (was 7) Potentially hanging thread: LeaseRenewer:jenkins@localhost:43129 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost:43129 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1124632911) connection to localhost/127.0.0.1:43129 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:43129 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45407 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1124632911) connection to localhost/127.0.0.1:43129 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1124632911) connection to localhost/127.0.0.1:43129 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1124632911) connection to localhost/127.0.0.1:43129 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@d3615e3 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: (jenkins-hbase4.apache.org,43805,1676570464786)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=541 (was 242) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=299 (was 145) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 168) - ProcessCount LEAK? -, AvailableMemoryMB=2065 (was 3634) 2023-02-16 18:01:20,011 INFO [Listener at localhost/45407] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=103, OpenFileDescriptor=541, MaxFileDescriptor=60000, SystemLoadAverage=299, ProcessCount=170, AvailableMemoryMB=2063 2023-02-16 18:01:20,022 INFO [Listener at localhost/45407] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9c71488a-f642-9649-d836-a74163cd870e/hadoop.log.dir so I do NOT create it in target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d 2023-02-16 18:01:20,022 WARN [Listener at localhost/45407] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9c71488a-f642-9649-d836-a74163cd870e/hadoop.log.dir Erasing configuration value by system value. 2023-02-16 18:01:20,022 INFO [Listener at localhost/45407] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9c71488a-f642-9649-d836-a74163cd870e/hadoop.tmp.dir so I do NOT create it in target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d 2023-02-16 18:01:20,022 WARN [Listener at localhost/45407] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9c71488a-f642-9649-d836-a74163cd870e/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-16 18:01:20,022 DEBUG [Listener at localhost/45407] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d 2023-02-16 18:01:20,022 INFO [Listener at localhost/45407] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-16 18:01:20,022 INFO [Listener at localhost/45407] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d/cluster_f15da503-3baf-0635-9396-1501f199f1c3, deleteOnExit=true 2023-02-16 18:01:20,022 INFO [Listener at localhost/45407] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-16 18:01:20,022 INFO [Listener at localhost/45407] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d/test.cache.data in system properties and HBase conf 2023-02-16 18:01:20,023 INFO [Listener at localhost/45407] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d/hadoop.tmp.dir in system properties and HBase conf 2023-02-16 18:01:20,023 INFO [Listener at localhost/45407] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d/hadoop.log.dir in system properties and HBase conf 2023-02-16 18:01:20,023 INFO [Listener at localhost/45407] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-16 18:01:20,023 INFO [Listener at localhost/45407] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-16 18:01:20,023 INFO [Listener at localhost/45407] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-16 18:01:20,023 DEBUG [Listener at localhost/45407] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-16 18:01:20,023 INFO [Listener at localhost/45407] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-16 18:01:20,023 INFO [Listener at localhost/45407] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-16 18:01:20,023 INFO [Listener at localhost/45407] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-16 18:01:20,024 INFO [Listener at localhost/45407] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 18:01:20,024 INFO [Listener at localhost/45407] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-16 18:01:20,024 INFO [Listener at localhost/45407] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-16 18:01:20,024 INFO [Listener at localhost/45407] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 18:01:20,024 INFO [Listener at localhost/45407] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 18:01:20,024 INFO [Listener at localhost/45407] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-16 18:01:20,024 INFO [Listener at localhost/45407] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d/nfs.dump.dir in system properties and HBase conf 2023-02-16 18:01:20,024 INFO [Listener at localhost/45407] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d/java.io.tmpdir in system properties and HBase conf 2023-02-16 18:01:20,024 INFO [Listener at localhost/45407] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 18:01:20,024 INFO [Listener at localhost/45407] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-16 18:01:20,025 INFO [Listener at localhost/45407] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-16 18:01:20,029 WARN [Listener at localhost/45407] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 18:01:20,029 WARN [Listener at localhost/45407] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 18:01:20,075 WARN [Listener at localhost/45407] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 18:01:20,078 INFO [Listener at localhost/45407] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 18:01:20,085 INFO [Listener at localhost/45407] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d/java.io.tmpdir/Jetty_localhost_35929_hdfs____eaynns/webapp 2023-02-16 18:01:20,199 INFO [Listener at localhost/45407] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35929 2023-02-16 18:01:20,203 WARN [Listener at localhost/45407] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 18:01:20,203 WARN [Listener at localhost/45407] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 18:01:20,245 WARN [Listener at localhost/43277] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 18:01:20,256 WARN [Listener at localhost/43277] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 18:01:20,258 WARN [Listener at localhost/43277] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 18:01:20,259 INFO [Listener at localhost/43277] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 18:01:20,264 INFO [Listener at localhost/43277] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d/java.io.tmpdir/Jetty_localhost_34597_datanode____.rkiayv/webapp 2023-02-16 18:01:20,354 INFO [Listener at localhost/43277] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34597 2023-02-16 18:01:20,361 WARN [Listener at localhost/45077] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 18:01:20,380 WARN [Listener at localhost/45077] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 18:01:20,382 WARN [Listener at localhost/45077] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 18:01:20,383 INFO [Listener at localhost/45077] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 18:01:20,386 INFO [Listener at localhost/45077] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d/java.io.tmpdir/Jetty_localhost_40047_datanode____grczry/webapp 2023-02-16 18:01:20,460 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x26a6749ec5512a64: Processing first storage report for DS-83e79f42-f46f-4662-9265-05b65dd09cb1 from datanode cc29d214-4123-4768-b12d-c938831425e8 2023-02-16 18:01:20,460 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x26a6749ec5512a64: from storage DS-83e79f42-f46f-4662-9265-05b65dd09cb1 node DatanodeRegistration(127.0.0.1:46495, datanodeUuid=cc29d214-4123-4768-b12d-c938831425e8, infoPort=33665, infoSecurePort=0, ipcPort=45077, storageInfo=lv=-57;cid=testClusterID;nsid=242173968;c=1676570480031), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 18:01:20,460 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x26a6749ec5512a64: Processing first storage report for DS-dae751ce-d0d9-438a-a3a4-cad77e2d5676 from datanode cc29d214-4123-4768-b12d-c938831425e8 2023-02-16 18:01:20,460 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x26a6749ec5512a64: from storage DS-dae751ce-d0d9-438a-a3a4-cad77e2d5676 node DatanodeRegistration(127.0.0.1:46495, datanodeUuid=cc29d214-4123-4768-b12d-c938831425e8, infoPort=33665, infoSecurePort=0, ipcPort=45077, storageInfo=lv=-57;cid=testClusterID;nsid=242173968;c=1676570480031), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 18:01:20,493 INFO [Listener at localhost/45077] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40047 2023-02-16 18:01:20,503 WARN [Listener at localhost/46409] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 18:01:20,610 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7befab5563075f03: Processing first storage report for DS-95a0bbca-07ef-4666-b27b-003138f22921 from datanode 19ace344-c048-460c-9dfe-925e16d36b0e 2023-02-16 18:01:20,611 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7befab5563075f03: from storage DS-95a0bbca-07ef-4666-b27b-003138f22921 node DatanodeRegistration(127.0.0.1:41077, datanodeUuid=19ace344-c048-460c-9dfe-925e16d36b0e, infoPort=38913, infoSecurePort=0, ipcPort=46409, storageInfo=lv=-57;cid=testClusterID;nsid=242173968;c=1676570480031), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 18:01:20,611 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7befab5563075f03: Processing first storage report for DS-ff2b7ad8-5332-46fc-b63b-186f87d5881a from datanode 19ace344-c048-460c-9dfe-925e16d36b0e 2023-02-16 18:01:20,611 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7befab5563075f03: from storage DS-ff2b7ad8-5332-46fc-b63b-186f87d5881a node DatanodeRegistration(127.0.0.1:41077, datanodeUuid=19ace344-c048-460c-9dfe-925e16d36b0e, infoPort=38913, infoSecurePort=0, ipcPort=46409, storageInfo=lv=-57;cid=testClusterID;nsid=242173968;c=1676570480031), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 18:01:20,613 DEBUG [Listener at localhost/46409] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d 2023-02-16 18:01:20,616 INFO [Listener at localhost/46409] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d/cluster_f15da503-3baf-0635-9396-1501f199f1c3/zookeeper_0, clientPort=51931, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d/cluster_f15da503-3baf-0635-9396-1501f199f1c3/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d/cluster_f15da503-3baf-0635-9396-1501f199f1c3/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-16 18:01:20,620 INFO [Listener at localhost/46409] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=51931 2023-02-16 18:01:20,620 INFO [Listener at localhost/46409] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:20,622 INFO [Listener at localhost/46409] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:20,643 INFO [Listener at localhost/46409] util.FSUtils(479): Created version file at hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f with version=8 2023-02-16 18:01:20,643 INFO [Listener at localhost/46409] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:20,645 INFO [Listener at localhost/46409] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:20,647 INFO [Listener at localhost/46409] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/hbase-staging 2023-02-16 18:01:20,649 INFO [Listener at localhost/46409] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 18:01:20,649 INFO [Listener at localhost/46409] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:20,649 INFO [Listener at localhost/46409] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:20,649 INFO [Listener at localhost/46409] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 18:01:20,649 INFO [Listener at localhost/46409] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:20,650 INFO [Listener at localhost/46409] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 18:01:20,650 INFO [Listener at localhost/46409] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 18:01:20,652 INFO [Listener at localhost/46409] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45927 2023-02-16 18:01:20,653 INFO [Listener at localhost/46409] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:20,654 INFO [Listener at localhost/46409] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:20,655 INFO [Listener at localhost/46409] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45927 connecting to ZooKeeper ensemble=127.0.0.1:51931 2023-02-16 18:01:20,666 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:459270x0, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 18:01:20,668 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:45927-0x1005e4b39ac0000 connected 2023-02-16 18:01:20,690 DEBUG [Listener at localhost/46409] zookeeper.ZKUtil(164): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 18:01:20,691 DEBUG [Listener at localhost/46409] zookeeper.ZKUtil(164): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:20,691 DEBUG [Listener at localhost/46409] zookeeper.ZKUtil(164): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 18:01:20,696 DEBUG [Listener at localhost/46409] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45927 2023-02-16 18:01:20,696 DEBUG [Listener at localhost/46409] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45927 2023-02-16 18:01:20,696 DEBUG [Listener at localhost/46409] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45927 2023-02-16 18:01:20,700 DEBUG [Listener at localhost/46409] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45927 2023-02-16 18:01:20,700 DEBUG [Listener at localhost/46409] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45927 2023-02-16 18:01:20,700 INFO [Listener at localhost/46409] master.HMaster(444): hbase.rootdir=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f, hbase.cluster.distributed=false 2023-02-16 18:01:20,717 INFO [Listener at localhost/46409] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 18:01:20,717 INFO [Listener at localhost/46409] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:20,717 INFO [Listener at localhost/46409] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:20,717 INFO [Listener at localhost/46409] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 18:01:20,717 INFO [Listener at localhost/46409] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:20,717 INFO [Listener at localhost/46409] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 18:01:20,717 INFO [Listener at localhost/46409] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 18:01:20,719 INFO [Listener at localhost/46409] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40551 2023-02-16 18:01:20,719 INFO [Listener at localhost/46409] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 18:01:20,720 DEBUG [Listener at localhost/46409] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:20,721 INFO [Listener at localhost/46409] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:20,722 INFO [Listener at localhost/46409] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:20,723 INFO [Listener at localhost/46409] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40551 connecting to ZooKeeper ensemble=127.0.0.1:51931 2023-02-16 18:01:20,726 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): regionserver:405510x0, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 18:01:20,727 DEBUG [Listener at localhost/46409] zookeeper.ZKUtil(164): regionserver:405510x0, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 18:01:20,727 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40551-0x1005e4b39ac0001 connected 2023-02-16 18:01:20,727 DEBUG [Listener at localhost/46409] zookeeper.ZKUtil(164): regionserver:40551-0x1005e4b39ac0001, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:20,728 DEBUG [Listener at localhost/46409] zookeeper.ZKUtil(164): regionserver:40551-0x1005e4b39ac0001, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 18:01:20,732 DEBUG [Listener at localhost/46409] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40551 2023-02-16 18:01:20,732 DEBUG [Listener at localhost/46409] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40551 2023-02-16 18:01:20,732 DEBUG [Listener at localhost/46409] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40551 2023-02-16 18:01:20,736 DEBUG [Listener at localhost/46409] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40551 2023-02-16 18:01:20,736 DEBUG [Listener at localhost/46409] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40551 2023-02-16 18:01:20,748 INFO [Listener at localhost/46409] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 18:01:20,748 INFO [Listener at localhost/46409] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:20,748 INFO [Listener at localhost/46409] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:20,748 INFO [Listener at localhost/46409] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 18:01:20,748 INFO [Listener at localhost/46409] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:20,748 INFO [Listener at localhost/46409] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 18:01:20,748 INFO [Listener at localhost/46409] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 18:01:20,750 INFO [Listener at localhost/46409] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42581 2023-02-16 18:01:20,750 INFO [Listener at localhost/46409] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 18:01:20,751 DEBUG [Listener at localhost/46409] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:20,752 INFO [Listener at localhost/46409] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:20,753 INFO [Listener at localhost/46409] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:20,754 INFO [Listener at localhost/46409] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42581 connecting to ZooKeeper ensemble=127.0.0.1:51931 2023-02-16 18:01:20,758 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): regionserver:425810x0, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 18:01:20,760 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42581-0x1005e4b39ac0002 connected 2023-02-16 18:01:20,760 DEBUG [Listener at localhost/46409] zookeeper.ZKUtil(164): regionserver:42581-0x1005e4b39ac0002, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 18:01:20,760 DEBUG [Listener at localhost/46409] zookeeper.ZKUtil(164): regionserver:42581-0x1005e4b39ac0002, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:20,761 DEBUG [Listener at localhost/46409] zookeeper.ZKUtil(164): regionserver:42581-0x1005e4b39ac0002, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 18:01:20,766 DEBUG [Listener at localhost/46409] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42581 2023-02-16 18:01:20,766 DEBUG [Listener at localhost/46409] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42581 2023-02-16 18:01:20,766 DEBUG [Listener at localhost/46409] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42581 2023-02-16 18:01:20,772 DEBUG [Listener at localhost/46409] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42581 2023-02-16 18:01:20,772 DEBUG [Listener at localhost/46409] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42581 2023-02-16 18:01:20,773 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,45927,1676570480648 2023-02-16 18:01:20,774 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 18:01:20,775 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,45927,1676570480648 2023-02-16 18:01:20,777 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 18:01:20,777 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x1005e4b39ac0001, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 18:01:20,777 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1005e4b39ac0002, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 18:01:20,777 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:20,779 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 18:01:20,781 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 18:01:20,781 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,45927,1676570480648 from backup master directory 2023-02-16 18:01:20,782 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,45927,1676570480648 2023-02-16 18:01:20,782 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 18:01:20,782 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 18:01:20,782 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,45927,1676570480648 2023-02-16 18:01:20,805 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/hbase.id with ID: 159d8ca2-8cce-4668-9da9-b83e1264352f 2023-02-16 18:01:20,816 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:20,818 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:20,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x101aacad to 127.0.0.1:51931 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 18:01:20,839 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b2cd636, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 18:01:20,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 18:01:20,840 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-16 18:01:20,840 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 18:01:20,841 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/MasterData/data/master/store-tmp 2023-02-16 18:01:20,851 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:20,851 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 18:01:20,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:20,851 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:20,851 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 18:01:20,851 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:20,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:20,851 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 18:01:20,852 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/MasterData/WALs/jenkins-hbase4.apache.org,45927,1676570480648 2023-02-16 18:01:20,854 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45927%2C1676570480648, suffix=, logDir=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/MasterData/WALs/jenkins-hbase4.apache.org,45927,1676570480648, archiveDir=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/MasterData/oldWALs, maxLogs=10 2023-02-16 18:01:20,870 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41077,DS-95a0bbca-07ef-4666-b27b-003138f22921,DISK] 2023-02-16 18:01:20,871 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46495,DS-83e79f42-f46f-4662-9265-05b65dd09cb1,DISK] 2023-02-16 18:01:20,874 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/MasterData/WALs/jenkins-hbase4.apache.org,45927,1676570480648/jenkins-hbase4.apache.org%2C45927%2C1676570480648.1676570480855 2023-02-16 18:01:20,874 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41077,DS-95a0bbca-07ef-4666-b27b-003138f22921,DISK], DatanodeInfoWithStorage[127.0.0.1:46495,DS-83e79f42-f46f-4662-9265-05b65dd09cb1,DISK]] 2023-02-16 18:01:20,875 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-16 18:01:20,875 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:20,875 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:20,875 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:20,879 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:20,881 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-16 18:01:20,881 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-16 18:01:20,882 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:20,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:20,883 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:20,885 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:20,887 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:20,888 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73148313, jitterRate=0.08999480307102203}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 18:01:20,888 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 18:01:20,888 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-16 18:01:20,889 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-16 18:01:20,889 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-16 18:01:20,889 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-16 18:01:20,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-16 18:01:20,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-16 18:01:20,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-16 18:01:20,892 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-16 18:01:20,893 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-16 18:01:20,905 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-16 18:01:20,905 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-16 18:01:20,905 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-16 18:01:20,905 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-16 18:01:20,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-16 18:01:20,910 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:20,911 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-16 18:01:20,911 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-16 18:01:20,912 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-16 18:01:20,913 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x1005e4b39ac0001, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:20,913 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1005e4b39ac0002, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:20,913 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:20,913 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:20,913 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,45927,1676570480648, sessionid=0x1005e4b39ac0000, setting cluster-up flag (Was=false) 2023-02-16 18:01:20,918 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:20,923 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-16 18:01:20,924 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45927,1676570480648 2023-02-16 18:01:20,928 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:20,932 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-16 18:01:20,933 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45927,1676570480648 2023-02-16 18:01:20,933 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.hbase-snapshot/.tmp 2023-02-16 18:01:20,935 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-16 18:01:20,936 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 18:01:20,936 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 18:01:20,936 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 18:01:20,936 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 18:01:20,936 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-16 18:01:20,936 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:20,936 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 18:01:20,936 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:20,945 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676570510945 2023-02-16 18:01:20,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-16 18:01:20,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-16 18:01:20,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-16 18:01:20,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-16 18:01:20,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-16 18:01:20,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-16 18:01:20,946 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 18:01:20,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:20,946 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-16 18:01:20,947 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-16 18:01:20,947 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-16 18:01:20,947 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-16 18:01:20,948 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-16 18:01:20,948 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-16 18:01:20,948 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 18:01:20,952 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676570480948,5,FailOnTimeoutGroup] 2023-02-16 18:01:20,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676570480956,5,FailOnTimeoutGroup] 2023-02-16 18:01:20,956 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:20,956 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-16 18:01:20,956 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:20,956 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:20,966 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 18:01:20,967 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 18:01:20,967 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f 2023-02-16 18:01:20,975 INFO [RS:1;jenkins-hbase4:42581] regionserver.HRegionServer(952): ClusterId : 159d8ca2-8cce-4668-9da9-b83e1264352f 2023-02-16 18:01:20,975 INFO [RS:0;jenkins-hbase4:40551] regionserver.HRegionServer(952): ClusterId : 159d8ca2-8cce-4668-9da9-b83e1264352f 2023-02-16 18:01:20,975 DEBUG [RS:1;jenkins-hbase4:42581] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 18:01:20,975 DEBUG [RS:0;jenkins-hbase4:40551] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 18:01:20,977 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:20,979 DEBUG [RS:0;jenkins-hbase4:40551] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 18:01:20,979 DEBUG [RS:1;jenkins-hbase4:42581] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 18:01:20,979 DEBUG [RS:0;jenkins-hbase4:40551] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 18:01:20,979 DEBUG [RS:1;jenkins-hbase4:42581] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 18:01:20,980 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 18:01:20,981 DEBUG [RS:0;jenkins-hbase4:40551] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 18:01:20,983 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/hbase/meta/1588230740/info 2023-02-16 18:01:20,983 DEBUG [RS:0;jenkins-hbase4:40551] zookeeper.ReadOnlyZKClient(139): Connect 0x1d8c2568 to 127.0.0.1:51931 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 18:01:20,983 DEBUG [RS:1;jenkins-hbase4:42581] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 18:01:20,984 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 18:01:20,984 DEBUG [RS:1;jenkins-hbase4:42581] zookeeper.ReadOnlyZKClient(139): Connect 0x01792ddb to 127.0.0.1:51931 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 18:01:20,985 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:20,985 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 18:01:20,986 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/hbase/meta/1588230740/rep_barrier 2023-02-16 18:01:20,987 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 18:01:20,987 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:20,988 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 18:01:20,994 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/hbase/meta/1588230740/table 2023-02-16 18:01:20,994 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 18:01:20,995 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:20,996 DEBUG [RS:0;jenkins-hbase4:40551] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@134bd8a9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 18:01:20,996 DEBUG [RS:0;jenkins-hbase4:40551] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17744e18, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 18:01:21,005 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/hbase/meta/1588230740 2023-02-16 18:01:21,006 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/hbase/meta/1588230740 2023-02-16 18:01:21,007 DEBUG [RS:1;jenkins-hbase4:42581] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@fbed384, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 18:01:21,007 DEBUG [RS:1;jenkins-hbase4:42581] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b8146ab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 18:01:21,007 DEBUG [RS:0;jenkins-hbase4:40551] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:40551 2023-02-16 18:01:21,008 INFO [RS:0;jenkins-hbase4:40551] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 18:01:21,008 INFO [RS:0;jenkins-hbase4:40551] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 18:01:21,008 DEBUG [RS:0;jenkins-hbase4:40551] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 18:01:21,008 INFO [RS:0;jenkins-hbase4:40551] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45927,1676570480648 with isa=jenkins-hbase4.apache.org/172.31.14.131:40551, startcode=1676570480716 2023-02-16 18:01:21,009 DEBUG [RS:0;jenkins-hbase4:40551] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 18:01:21,009 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 18:01:21,011 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 18:01:21,014 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34847, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 18:01:21,015 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:21,016 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61090051, jitterRate=-0.0896873027086258}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 18:01:21,016 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 18:01:21,016 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 18:01:21,016 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 18:01:21,016 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 18:01:21,016 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 18:01:21,016 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 18:01:21,020 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 18:01:21,020 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 18:01:21,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45927] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:21,022 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 18:01:21,022 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-16 18:01:21,022 DEBUG [RS:0;jenkins-hbase4:40551] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f 2023-02-16 18:01:21,022 DEBUG [RS:0;jenkins-hbase4:40551] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:43277 2023-02-16 18:01:21,022 DEBUG [RS:0;jenkins-hbase4:40551] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 18:01:21,024 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-16 18:01:21,026 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:21,027 DEBUG [RS:0;jenkins-hbase4:40551] zookeeper.ZKUtil(162): regionserver:40551-0x1005e4b39ac0001, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:21,027 WARN [RS:0;jenkins-hbase4:40551] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 18:01:21,028 INFO [RS:0;jenkins-hbase4:40551] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 18:01:21,028 DEBUG [RS:0;jenkins-hbase4:40551] regionserver.HRegionServer(1947): logDir=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/WALs/jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:21,029 DEBUG [RS:1;jenkins-hbase4:42581] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:42581 2023-02-16 18:01:21,030 INFO [RS:1;jenkins-hbase4:42581] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 18:01:21,030 INFO [RS:1;jenkins-hbase4:42581] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 18:01:21,030 DEBUG [RS:1;jenkins-hbase4:42581] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 18:01:21,031 INFO [RS:1;jenkins-hbase4:42581] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45927,1676570480648 with isa=jenkins-hbase4.apache.org/172.31.14.131:42581, startcode=1676570480748 2023-02-16 18:01:21,031 DEBUG [RS:1;jenkins-hbase4:42581] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 18:01:21,034 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-16 18:01:21,036 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48635, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 18:01:21,037 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40551,1676570480716] 2023-02-16 18:01:21,037 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-16 18:01:21,037 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45927] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:21,037 DEBUG [RS:1;jenkins-hbase4:42581] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f 2023-02-16 18:01:21,037 DEBUG [RS:1;jenkins-hbase4:42581] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:43277 2023-02-16 18:01:21,037 DEBUG [RS:1;jenkins-hbase4:42581] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 18:01:21,041 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:21,042 DEBUG [RS:1;jenkins-hbase4:42581] zookeeper.ZKUtil(162): regionserver:42581-0x1005e4b39ac0002, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:21,042 WARN [RS:1;jenkins-hbase4:42581] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 18:01:21,042 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42581,1676570480748] 2023-02-16 18:01:21,042 INFO [RS:1;jenkins-hbase4:42581] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 18:01:21,042 DEBUG [RS:0;jenkins-hbase4:40551] zookeeper.ZKUtil(162): regionserver:40551-0x1005e4b39ac0001, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:21,042 DEBUG [RS:1;jenkins-hbase4:42581] regionserver.HRegionServer(1947): logDir=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/WALs/jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:21,042 DEBUG [RS:0;jenkins-hbase4:40551] zookeeper.ZKUtil(162): regionserver:40551-0x1005e4b39ac0001, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:21,043 DEBUG [RS:0;jenkins-hbase4:40551] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 18:01:21,044 INFO [RS:0;jenkins-hbase4:40551] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 18:01:21,048 INFO [RS:0;jenkins-hbase4:40551] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 18:01:21,049 INFO [RS:0;jenkins-hbase4:40551] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 18:01:21,049 INFO [RS:0;jenkins-hbase4:40551] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:21,052 INFO [RS:0;jenkins-hbase4:40551] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 18:01:21,053 INFO [RS:0;jenkins-hbase4:40551] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:21,053 DEBUG [RS:0;jenkins-hbase4:40551] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:21,053 DEBUG [RS:0;jenkins-hbase4:40551] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:21,053 DEBUG [RS:0;jenkins-hbase4:40551] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:21,054 DEBUG [RS:0;jenkins-hbase4:40551] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:21,054 DEBUG [RS:0;jenkins-hbase4:40551] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:21,054 DEBUG [RS:0;jenkins-hbase4:40551] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 18:01:21,054 DEBUG [RS:0;jenkins-hbase4:40551] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:21,054 DEBUG [RS:0;jenkins-hbase4:40551] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:21,054 DEBUG [RS:1;jenkins-hbase4:42581] zookeeper.ZKUtil(162): regionserver:42581-0x1005e4b39ac0002, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:21,054 DEBUG [RS:0;jenkins-hbase4:40551] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:21,054 DEBUG [RS:0;jenkins-hbase4:40551] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:21,054 DEBUG [RS:1;jenkins-hbase4:42581] zookeeper.ZKUtil(162): regionserver:42581-0x1005e4b39ac0002, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:21,055 INFO [RS:0;jenkins-hbase4:40551] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:21,055 INFO [RS:0;jenkins-hbase4:40551] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:21,055 INFO [RS:0;jenkins-hbase4:40551] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:21,056 DEBUG [RS:1;jenkins-hbase4:42581] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 18:01:21,056 INFO [RS:1;jenkins-hbase4:42581] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 18:01:21,059 INFO [RS:1;jenkins-hbase4:42581] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 18:01:21,060 INFO [RS:1;jenkins-hbase4:42581] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 18:01:21,060 INFO [RS:1;jenkins-hbase4:42581] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:21,060 INFO [RS:1;jenkins-hbase4:42581] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 18:01:21,061 INFO [RS:1;jenkins-hbase4:42581] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:21,061 DEBUG [RS:1;jenkins-hbase4:42581] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:21,061 DEBUG [RS:1;jenkins-hbase4:42581] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:21,062 DEBUG [RS:1;jenkins-hbase4:42581] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:21,062 DEBUG [RS:1;jenkins-hbase4:42581] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:21,062 DEBUG [RS:1;jenkins-hbase4:42581] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:21,062 DEBUG [RS:1;jenkins-hbase4:42581] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 18:01:21,062 DEBUG [RS:1;jenkins-hbase4:42581] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:21,062 DEBUG [RS:1;jenkins-hbase4:42581] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:21,062 DEBUG [RS:1;jenkins-hbase4:42581] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:21,062 DEBUG [RS:1;jenkins-hbase4:42581] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:21,065 INFO [RS:1;jenkins-hbase4:42581] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:21,065 INFO [RS:1;jenkins-hbase4:42581] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:21,065 INFO [RS:1;jenkins-hbase4:42581] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:21,070 INFO [RS:0;jenkins-hbase4:40551] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 18:01:21,071 INFO [RS:0;jenkins-hbase4:40551] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40551,1676570480716-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:21,082 INFO [RS:1;jenkins-hbase4:42581] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 18:01:21,082 INFO [RS:1;jenkins-hbase4:42581] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42581,1676570480748-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:21,084 INFO [RS:0;jenkins-hbase4:40551] regionserver.Replication(203): jenkins-hbase4.apache.org,40551,1676570480716 started 2023-02-16 18:01:21,084 INFO [RS:0;jenkins-hbase4:40551] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,40551,1676570480716, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40551, sessionid=0x1005e4b39ac0001 2023-02-16 18:01:21,084 DEBUG [RS:0;jenkins-hbase4:40551] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 18:01:21,084 DEBUG [RS:0;jenkins-hbase4:40551] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:21,084 DEBUG [RS:0;jenkins-hbase4:40551] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40551,1676570480716' 2023-02-16 18:01:21,084 DEBUG [RS:0;jenkins-hbase4:40551] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:21,085 DEBUG [RS:0;jenkins-hbase4:40551] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:21,085 DEBUG [RS:0;jenkins-hbase4:40551] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 18:01:21,085 DEBUG [RS:0;jenkins-hbase4:40551] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 18:01:21,085 DEBUG [RS:0;jenkins-hbase4:40551] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:21,085 DEBUG [RS:0;jenkins-hbase4:40551] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40551,1676570480716' 2023-02-16 18:01:21,085 DEBUG [RS:0;jenkins-hbase4:40551] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:21,085 DEBUG [RS:0;jenkins-hbase4:40551] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:21,086 DEBUG [RS:0;jenkins-hbase4:40551] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 18:01:21,086 INFO [RS:0;jenkins-hbase4:40551] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 18:01:21,086 INFO [RS:0;jenkins-hbase4:40551] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 18:01:21,093 INFO [RS:1;jenkins-hbase4:42581] regionserver.Replication(203): jenkins-hbase4.apache.org,42581,1676570480748 started 2023-02-16 18:01:21,093 INFO [RS:1;jenkins-hbase4:42581] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,42581,1676570480748, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42581, sessionid=0x1005e4b39ac0002 2023-02-16 18:01:21,093 DEBUG [RS:1;jenkins-hbase4:42581] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 18:01:21,093 DEBUG [RS:1;jenkins-hbase4:42581] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:21,093 DEBUG [RS:1;jenkins-hbase4:42581] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42581,1676570480748' 2023-02-16 18:01:21,093 DEBUG [RS:1;jenkins-hbase4:42581] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:21,094 DEBUG [RS:1;jenkins-hbase4:42581] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:21,094 DEBUG [RS:1;jenkins-hbase4:42581] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 18:01:21,094 DEBUG [RS:1;jenkins-hbase4:42581] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 18:01:21,094 DEBUG [RS:1;jenkins-hbase4:42581] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:21,094 DEBUG [RS:1;jenkins-hbase4:42581] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42581,1676570480748' 2023-02-16 18:01:21,094 DEBUG [RS:1;jenkins-hbase4:42581] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:21,095 DEBUG [RS:1;jenkins-hbase4:42581] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:21,095 DEBUG [RS:1;jenkins-hbase4:42581] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 18:01:21,095 INFO [RS:1;jenkins-hbase4:42581] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 18:01:21,095 INFO [RS:1;jenkins-hbase4:42581] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 18:01:21,187 DEBUG [jenkins-hbase4:45927] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-16 18:01:21,187 DEBUG [jenkins-hbase4:45927] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 18:01:21,189 DEBUG [jenkins-hbase4:45927] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 18:01:21,189 DEBUG [jenkins-hbase4:45927] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 18:01:21,189 DEBUG [jenkins-hbase4:45927] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 18:01:21,190 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40551,1676570480716, state=OPENING 2023-02-16 18:01:21,192 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-16 18:01:21,194 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:21,194 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40551,1676570480716}] 2023-02-16 18:01:21,194 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 18:01:21,348 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:21,349 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 18:01:21,352 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41536, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 18:01:21,357 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-16 18:01:21,358 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 18:01:21,359 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40551%2C1676570480716.meta, suffix=.meta, logDir=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/WALs/jenkins-hbase4.apache.org,40551,1676570480716, archiveDir=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/oldWALs, maxLogs=32 2023-02-16 18:01:21,387 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41077,DS-95a0bbca-07ef-4666-b27b-003138f22921,DISK] 2023-02-16 18:01:21,387 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46495,DS-83e79f42-f46f-4662-9265-05b65dd09cb1,DISK] 2023-02-16 18:01:21,391 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/WALs/jenkins-hbase4.apache.org,40551,1676570480716/jenkins-hbase4.apache.org%2C40551%2C1676570480716.meta.1676570481361.meta 2023-02-16 18:01:21,392 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46495,DS-83e79f42-f46f-4662-9265-05b65dd09cb1,DISK], DatanodeInfoWithStorage[127.0.0.1:41077,DS-95a0bbca-07ef-4666-b27b-003138f22921,DISK]] 2023-02-16 18:01:21,392 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-16 18:01:21,392 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-16 18:01:21,392 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-16 18:01:21,394 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-16 18:01:21,394 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-16 18:01:21,394 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:21,394 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-16 18:01:21,394 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-16 18:01:21,397 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 18:01:21,398 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/hbase/meta/1588230740/info 2023-02-16 18:01:21,398 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/hbase/meta/1588230740/info 2023-02-16 18:01:21,399 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 18:01:21,399 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:21,399 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 18:01:21,400 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/hbase/meta/1588230740/rep_barrier 2023-02-16 18:01:21,400 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/hbase/meta/1588230740/rep_barrier 2023-02-16 18:01:21,400 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 18:01:21,406 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:21,406 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 18:01:21,408 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/hbase/meta/1588230740/table 2023-02-16 18:01:21,408 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/hbase/meta/1588230740/table 2023-02-16 18:01:21,408 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 18:01:21,409 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:21,410 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/hbase/meta/1588230740 2023-02-16 18:01:21,411 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/hbase/meta/1588230740 2023-02-16 18:01:21,415 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 18:01:21,416 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 18:01:21,417 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69703760, jitterRate=0.03866696357727051}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 18:01:21,417 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 18:01:21,418 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676570481348 2023-02-16 18:01:21,422 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-16 18:01:21,423 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-16 18:01:21,423 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40551,1676570480716, state=OPEN 2023-02-16 18:01:21,425 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-16 18:01:21,425 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 18:01:21,427 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-16 18:01:21,427 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40551,1676570480716 in 231 msec 2023-02-16 18:01:21,428 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-16 18:01:21,429 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 403 msec 2023-02-16 18:01:21,431 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 495 msec 2023-02-16 18:01:21,431 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676570481431, completionTime=-1 2023-02-16 18:01:21,431 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-16 18:01:21,431 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-16 18:01:21,437 DEBUG [hconnection-0x61436b58-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 18:01:21,440 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41548, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 18:01:21,441 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-16 18:01:21,441 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676570541441 2023-02-16 18:01:21,441 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676570601441 2023-02-16 18:01:21,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 10 msec 2023-02-16 18:01:21,451 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45927,1676570480648-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:21,451 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45927,1676570480648-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:21,451 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45927,1676570480648-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:21,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:45927, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:21,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:21,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-16 18:01:21,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 18:01:21,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-16 18:01:21,455 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-16 18:01:21,455 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 18:01:21,456 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 18:01:21,458 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp/data/hbase/namespace/8222039b4a86ba55c0bc50e2086dd442 2023-02-16 18:01:21,459 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp/data/hbase/namespace/8222039b4a86ba55c0bc50e2086dd442 empty. 2023-02-16 18:01:21,459 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp/data/hbase/namespace/8222039b4a86ba55c0bc50e2086dd442 2023-02-16 18:01:21,459 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-16 18:01:21,479 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-16 18:01:21,480 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 8222039b4a86ba55c0bc50e2086dd442, NAME => 'hbase:namespace,,1676570481452.8222039b4a86ba55c0bc50e2086dd442.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp 2023-02-16 18:01:21,495 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676570481452.8222039b4a86ba55c0bc50e2086dd442.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:21,495 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 8222039b4a86ba55c0bc50e2086dd442, disabling compactions & flushes 2023-02-16 18:01:21,495 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676570481452.8222039b4a86ba55c0bc50e2086dd442. 2023-02-16 18:01:21,495 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676570481452.8222039b4a86ba55c0bc50e2086dd442. 2023-02-16 18:01:21,495 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676570481452.8222039b4a86ba55c0bc50e2086dd442. after waiting 0 ms 2023-02-16 18:01:21,495 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676570481452.8222039b4a86ba55c0bc50e2086dd442. 2023-02-16 18:01:21,495 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676570481452.8222039b4a86ba55c0bc50e2086dd442. 2023-02-16 18:01:21,495 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 8222039b4a86ba55c0bc50e2086dd442: 2023-02-16 18:01:21,498 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 18:01:21,499 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676570481452.8222039b4a86ba55c0bc50e2086dd442.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676570481499"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570481499"}]},"ts":"1676570481499"} 2023-02-16 18:01:21,511 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 18:01:21,513 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 18:01:21,513 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676570481513"}]},"ts":"1676570481513"} 2023-02-16 18:01:21,516 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-16 18:01:21,520 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 18:01:21,521 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 18:01:21,521 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 18:01:21,521 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 18:01:21,521 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8222039b4a86ba55c0bc50e2086dd442, ASSIGN}] 2023-02-16 18:01:21,524 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8222039b4a86ba55c0bc50e2086dd442, ASSIGN 2023-02-16 18:01:21,525 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=8222039b4a86ba55c0bc50e2086dd442, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40551,1676570480716; forceNewPlan=false, retain=false 2023-02-16 18:01:21,676 INFO [jenkins-hbase4:45927] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 18:01:21,677 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8222039b4a86ba55c0bc50e2086dd442, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:21,677 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676570481452.8222039b4a86ba55c0bc50e2086dd442.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676570481677"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570481677"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570481677"}]},"ts":"1676570481677"} 2023-02-16 18:01:21,742 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 8222039b4a86ba55c0bc50e2086dd442, server=jenkins-hbase4.apache.org,40551,1676570480716}] 2023-02-16 18:01:21,899 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676570481452.8222039b4a86ba55c0bc50e2086dd442. 2023-02-16 18:01:21,900 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40551%2C1676570480716, suffix=, logDir=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/WALs/jenkins-hbase4.apache.org,40551,1676570480716, archiveDir=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/oldWALs, maxLogs=32 2023-02-16 18:01:21,918 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41077,DS-95a0bbca-07ef-4666-b27b-003138f22921,DISK] 2023-02-16 18:01:21,920 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46495,DS-83e79f42-f46f-4662-9265-05b65dd09cb1,DISK] 2023-02-16 18:01:21,922 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/WALs/jenkins-hbase4.apache.org,40551,1676570480716/jenkins-hbase4.apache.org%2C40551%2C1676570480716.1676570481902 2023-02-16 18:01:21,923 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41077,DS-95a0bbca-07ef-4666-b27b-003138f22921,DISK], DatanodeInfoWithStorage[127.0.0.1:46495,DS-83e79f42-f46f-4662-9265-05b65dd09cb1,DISK]] 2023-02-16 18:01:21,923 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8222039b4a86ba55c0bc50e2086dd442, NAME => 'hbase:namespace,,1676570481452.8222039b4a86ba55c0bc50e2086dd442.', STARTKEY => '', ENDKEY => ''} 2023-02-16 18:01:21,923 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 8222039b4a86ba55c0bc50e2086dd442 2023-02-16 18:01:21,923 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676570481452.8222039b4a86ba55c0bc50e2086dd442.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:21,923 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8222039b4a86ba55c0bc50e2086dd442 2023-02-16 18:01:21,923 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8222039b4a86ba55c0bc50e2086dd442 2023-02-16 18:01:21,925 INFO [StoreOpener-8222039b4a86ba55c0bc50e2086dd442-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 8222039b4a86ba55c0bc50e2086dd442 2023-02-16 18:01:21,926 DEBUG [StoreOpener-8222039b4a86ba55c0bc50e2086dd442-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/hbase/namespace/8222039b4a86ba55c0bc50e2086dd442/info 2023-02-16 18:01:21,926 DEBUG [StoreOpener-8222039b4a86ba55c0bc50e2086dd442-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/hbase/namespace/8222039b4a86ba55c0bc50e2086dd442/info 2023-02-16 18:01:21,927 INFO [StoreOpener-8222039b4a86ba55c0bc50e2086dd442-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8222039b4a86ba55c0bc50e2086dd442 columnFamilyName info 2023-02-16 18:01:21,927 INFO [StoreOpener-8222039b4a86ba55c0bc50e2086dd442-1] regionserver.HStore(310): Store=8222039b4a86ba55c0bc50e2086dd442/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:21,928 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/hbase/namespace/8222039b4a86ba55c0bc50e2086dd442 2023-02-16 18:01:21,928 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/hbase/namespace/8222039b4a86ba55c0bc50e2086dd442 2023-02-16 18:01:21,931 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8222039b4a86ba55c0bc50e2086dd442 2023-02-16 18:01:21,932 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/hbase/namespace/8222039b4a86ba55c0bc50e2086dd442/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:21,933 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8222039b4a86ba55c0bc50e2086dd442; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65498122, jitterRate=-0.02400192618370056}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 18:01:21,933 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8222039b4a86ba55c0bc50e2086dd442: 2023-02-16 18:01:21,934 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676570481452.8222039b4a86ba55c0bc50e2086dd442., pid=6, masterSystemTime=1676570481894 2023-02-16 18:01:21,936 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676570481452.8222039b4a86ba55c0bc50e2086dd442. 2023-02-16 18:01:21,936 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676570481452.8222039b4a86ba55c0bc50e2086dd442. 2023-02-16 18:01:21,937 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8222039b4a86ba55c0bc50e2086dd442, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:21,937 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676570481452.8222039b4a86ba55c0bc50e2086dd442.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676570481937"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676570481937"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676570481937"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676570481937"}]},"ts":"1676570481937"} 2023-02-16 18:01:21,940 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-16 18:01:21,940 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 8222039b4a86ba55c0bc50e2086dd442, server=jenkins-hbase4.apache.org,40551,1676570480716 in 197 msec 2023-02-16 18:01:21,943 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-16 18:01:21,943 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=8222039b4a86ba55c0bc50e2086dd442, ASSIGN in 419 msec 2023-02-16 18:01:21,943 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 18:01:21,944 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676570481943"}]},"ts":"1676570481943"} 2023-02-16 18:01:21,945 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-16 18:01:21,948 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 18:01:21,949 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 496 msec 2023-02-16 18:01:21,954 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-16 18:01:21,959 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-16 18:01:21,959 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:21,964 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-16 18:01:21,972 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 18:01:21,975 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-02-16 18:01:21,985 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-16 18:01:21,992 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 18:01:21,995 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-16 18:01:22,009 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-16 18:01:22,017 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-16 18:01:22,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.235sec 2023-02-16 18:01:22,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-16 18:01:22,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-16 18:01:22,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-16 18:01:22,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45927,1676570480648-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-16 18:01:22,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45927,1676570480648-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-16 18:01:22,019 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-16 18:01:22,075 DEBUG [Listener at localhost/46409] zookeeper.ReadOnlyZKClient(139): Connect 0x7216b6f3 to 127.0.0.1:51931 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 18:01:22,081 DEBUG [Listener at localhost/46409] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7728c839, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 18:01:22,083 DEBUG [hconnection-0x2f60ba40-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 18:01:22,086 INFO [RS-EventLoopGroup-7-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41564, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 18:01:22,088 INFO [Listener at localhost/46409] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,45927,1676570480648 2023-02-16 18:01:22,088 DEBUG [Listener at localhost/46409] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-16 18:01:22,089 DEBUG [Listener at localhost/46409] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-16 18:01:22,091 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42916, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-16 18:01:22,092 INFO [Listener at localhost/46409] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-16 18:01:22,092 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45927] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-16 18:01:22,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45927] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-16 18:01:22,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45927] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 78 connection: 172.31.14.131:42916 deadline: 1676570542092, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-16 18:01:22,093 INFO [Listener at localhost/46409] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-16 18:01:22,095 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45927] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 18:01:22,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45927] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-16 18:01:22,098 INFO [RS:1;jenkins-hbase4:42581] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42581%2C1676570480748, suffix=, logDir=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/WALs/jenkins-hbase4.apache.org,42581,1676570480748, archiveDir=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/oldWALs, maxLogs=32 2023-02-16 18:01:22,098 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 18:01:22,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45927] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-16 18:01:22,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45927] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 18:01:22,101 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 18:01:22,111 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp/data/default/testWithMapReduce/f6fea7abf2b32dbe67a267c0cf01e593 2023-02-16 18:01:22,111 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp/data/default/testWithMapReduce/ff112adcde372b676d79e75223744fae 2023-02-16 18:01:22,111 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp/data/default/testWithMapReduce/8fdec3876078f55081787f24f961828a 2023-02-16 18:01:22,111 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp/data/default/testWithMapReduce/d429632777f89bb78e78ce013de08e64 2023-02-16 18:01:22,111 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp/data/default/testWithMapReduce/da4e4d853fcab29265a5ca41991cbfb7 2023-02-16 18:01:22,111 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp/data/default/testWithMapReduce/eb6d74bacfba537526abbce930880639 2023-02-16 18:01:22,111 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp/data/default/testWithMapReduce/19e292fb23dca311f01841f682b38f19 2023-02-16 18:01:22,111 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp/data/default/testWithMapReduce/3eb4596533e4744167c987c3f9928464 2023-02-16 18:01:22,111 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp/data/default/testWithMapReduce/f6fea7abf2b32dbe67a267c0cf01e593 empty. 2023-02-16 18:01:22,112 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp/data/default/testWithMapReduce/8fdec3876078f55081787f24f961828a empty. 2023-02-16 18:01:22,112 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp/data/default/testWithMapReduce/da4e4d853fcab29265a5ca41991cbfb7 empty. 2023-02-16 18:01:22,112 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp/data/default/testWithMapReduce/ff112adcde372b676d79e75223744fae empty. 2023-02-16 18:01:22,112 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp/data/default/testWithMapReduce/d429632777f89bb78e78ce013de08e64 empty. 2023-02-16 18:01:22,112 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp/data/default/testWithMapReduce/3eb4596533e4744167c987c3f9928464 empty. 2023-02-16 18:01:22,112 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp/data/default/testWithMapReduce/f6fea7abf2b32dbe67a267c0cf01e593 2023-02-16 18:01:22,112 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp/data/default/testWithMapReduce/31afd44b71d5642a373135dee5b626ea 2023-02-16 18:01:22,112 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp/data/default/testWithMapReduce/da4e4d853fcab29265a5ca41991cbfb7 2023-02-16 18:01:22,113 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp/data/default/testWithMapReduce/e155df5ccc3da2f833eca9746ce9ba33 2023-02-16 18:01:22,113 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp/data/default/testWithMapReduce/19e292fb23dca311f01841f682b38f19 empty. 2023-02-16 18:01:22,113 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp/data/default/testWithMapReduce/eb6d74bacfba537526abbce930880639 empty. 2023-02-16 18:01:22,113 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp/data/default/testWithMapReduce/ff112adcde372b676d79e75223744fae 2023-02-16 18:01:22,113 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp/data/default/testWithMapReduce/3eb4596533e4744167c987c3f9928464 2023-02-16 18:01:22,113 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp/data/default/testWithMapReduce/d429632777f89bb78e78ce013de08e64 2023-02-16 18:01:22,114 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp/data/default/testWithMapReduce/8fdec3876078f55081787f24f961828a 2023-02-16 18:01:22,114 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp/data/default/testWithMapReduce/eb6d74bacfba537526abbce930880639 2023-02-16 18:01:22,114 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp/data/default/testWithMapReduce/19e292fb23dca311f01841f682b38f19 2023-02-16 18:01:22,114 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp/data/default/testWithMapReduce/e155df5ccc3da2f833eca9746ce9ba33 empty. 2023-02-16 18:01:22,114 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp/data/default/testWithMapReduce/31afd44b71d5642a373135dee5b626ea empty. 2023-02-16 18:01:22,114 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp/data/default/testWithMapReduce/e155df5ccc3da2f833eca9746ce9ba33 2023-02-16 18:01:22,114 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp/data/default/testWithMapReduce/31afd44b71d5642a373135dee5b626ea 2023-02-16 18:01:22,114 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-16 18:01:22,132 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46495,DS-83e79f42-f46f-4662-9265-05b65dd09cb1,DISK] 2023-02-16 18:01:22,133 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41077,DS-95a0bbca-07ef-4666-b27b-003138f22921,DISK] 2023-02-16 18:01:22,134 INFO [RS:1;jenkins-hbase4:42581] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/WALs/jenkins-hbase4.apache.org,42581,1676570480748/jenkins-hbase4.apache.org%2C42581%2C1676570480748.1676570482099 2023-02-16 18:01:22,135 DEBUG [RS:1;jenkins-hbase4:42581] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41077,DS-95a0bbca-07ef-4666-b27b-003138f22921,DISK], DatanodeInfoWithStorage[127.0.0.1:46495,DS-83e79f42-f46f-4662-9265-05b65dd09cb1,DISK]] 2023-02-16 18:01:22,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45927] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 18:01:22,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45927] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 18:01:22,534 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-16 18:01:22,536 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => f6fea7abf2b32dbe67a267c0cf01e593, NAME => 'testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp 2023-02-16 18:01:22,536 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 19e292fb23dca311f01841f682b38f19, NAME => 'testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp 2023-02-16 18:01:22,536 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 3eb4596533e4744167c987c3f9928464, NAME => 'testWithMapReduce,d\x84\x84,1676570482095.3eb4596533e4744167c987c3f9928464.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp 2023-02-16 18:01:22,559 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:22,559 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing f6fea7abf2b32dbe67a267c0cf01e593, disabling compactions & flushes 2023-02-16 18:01:22,559 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593. 2023-02-16 18:01:22,559 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593. 2023-02-16 18:01:22,559 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593. after waiting 0 ms 2023-02-16 18:01:22,559 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593. 2023-02-16 18:01:22,559 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593. 2023-02-16 18:01:22,559 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for f6fea7abf2b32dbe67a267c0cf01e593: 2023-02-16 18:01:22,561 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => eb6d74bacfba537526abbce930880639, NAME => 'testWithMapReduce,g\xA7\xA7,1676570482095.eb6d74bacfba537526abbce930880639.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp 2023-02-16 18:01:22,561 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676570482095.3eb4596533e4744167c987c3f9928464.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:22,561 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 3eb4596533e4744167c987c3f9928464, disabling compactions & flushes 2023-02-16 18:01:22,561 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676570482095.3eb4596533e4744167c987c3f9928464. 2023-02-16 18:01:22,561 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676570482095.3eb4596533e4744167c987c3f9928464. 2023-02-16 18:01:22,561 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676570482095.3eb4596533e4744167c987c3f9928464. after waiting 0 ms 2023-02-16 18:01:22,561 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676570482095.3eb4596533e4744167c987c3f9928464. 2023-02-16 18:01:22,561 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676570482095.3eb4596533e4744167c987c3f9928464. 2023-02-16 18:01:22,561 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 3eb4596533e4744167c987c3f9928464: 2023-02-16 18:01:22,562 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => ff112adcde372b676d79e75223744fae, NAME => 'testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp 2023-02-16 18:01:22,576 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:22,576 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing ff112adcde372b676d79e75223744fae, disabling compactions & flushes 2023-02-16 18:01:22,576 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae. 2023-02-16 18:01:22,576 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae. 2023-02-16 18:01:22,576 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae. after waiting 0 ms 2023-02-16 18:01:22,576 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae. 2023-02-16 18:01:22,576 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae. 2023-02-16 18:01:22,576 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for ff112adcde372b676d79e75223744fae: 2023-02-16 18:01:22,576 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676570482095.eb6d74bacfba537526abbce930880639.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:22,577 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing eb6d74bacfba537526abbce930880639, disabling compactions & flushes 2023-02-16 18:01:22,577 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => da4e4d853fcab29265a5ca41991cbfb7, NAME => 'testWithMapReduce,m\xED\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp 2023-02-16 18:01:22,577 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676570482095.eb6d74bacfba537526abbce930880639. 2023-02-16 18:01:22,577 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676570482095.eb6d74bacfba537526abbce930880639. 2023-02-16 18:01:22,577 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676570482095.eb6d74bacfba537526abbce930880639. after waiting 0 ms 2023-02-16 18:01:22,577 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676570482095.eb6d74bacfba537526abbce930880639. 2023-02-16 18:01:22,577 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676570482095.eb6d74bacfba537526abbce930880639. 2023-02-16 18:01:22,577 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for eb6d74bacfba537526abbce930880639: 2023-02-16 18:01:22,577 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => d429632777f89bb78e78ce013de08e64, NAME => 'testWithMapReduce,q\x11\x10,1676570482095.d429632777f89bb78e78ce013de08e64.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp 2023-02-16 18:01:22,584 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676570482095.d429632777f89bb78e78ce013de08e64.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:22,584 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:22,584 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing d429632777f89bb78e78ce013de08e64, disabling compactions & flushes 2023-02-16 18:01:22,584 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing da4e4d853fcab29265a5ca41991cbfb7, disabling compactions & flushes 2023-02-16 18:01:22,584 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676570482095.d429632777f89bb78e78ce013de08e64. 2023-02-16 18:01:22,584 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7. 2023-02-16 18:01:22,585 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7. 2023-02-16 18:01:22,584 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676570482095.d429632777f89bb78e78ce013de08e64. 2023-02-16 18:01:22,585 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7. after waiting 0 ms 2023-02-16 18:01:22,585 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7. 2023-02-16 18:01:22,585 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676570482095.d429632777f89bb78e78ce013de08e64. after waiting 0 ms 2023-02-16 18:01:22,585 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7. 2023-02-16 18:01:22,585 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for da4e4d853fcab29265a5ca41991cbfb7: 2023-02-16 18:01:22,585 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676570482095.d429632777f89bb78e78ce013de08e64. 2023-02-16 18:01:22,585 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676570482095.d429632777f89bb78e78ce013de08e64. 2023-02-16 18:01:22,585 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for d429632777f89bb78e78ce013de08e64: 2023-02-16 18:01:22,585 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 8fdec3876078f55081787f24f961828a, NAME => 'testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp 2023-02-16 18:01:22,585 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 31afd44b71d5642a373135dee5b626ea, NAME => 'testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp 2023-02-16 18:01:22,593 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:22,593 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 31afd44b71d5642a373135dee5b626ea, disabling compactions & flushes 2023-02-16 18:01:22,593 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea. 2023-02-16 18:01:22,593 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea. 2023-02-16 18:01:22,593 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea. after waiting 0 ms 2023-02-16 18:01:22,593 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea. 2023-02-16 18:01:22,593 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea. 2023-02-16 18:01:22,593 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 31afd44b71d5642a373135dee5b626ea: 2023-02-16 18:01:22,594 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => e155df5ccc3da2f833eca9746ce9ba33, NAME => 'testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.tmp 2023-02-16 18:01:22,596 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:22,596 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 8fdec3876078f55081787f24f961828a, disabling compactions & flushes 2023-02-16 18:01:22,596 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a. 2023-02-16 18:01:22,596 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a. 2023-02-16 18:01:22,596 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a. after waiting 0 ms 2023-02-16 18:01:22,596 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a. 2023-02-16 18:01:22,596 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a. 2023-02-16 18:01:22,596 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 8fdec3876078f55081787f24f961828a: 2023-02-16 18:01:22,600 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:22,600 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing e155df5ccc3da2f833eca9746ce9ba33, disabling compactions & flushes 2023-02-16 18:01:22,600 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33. 2023-02-16 18:01:22,600 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33. 2023-02-16 18:01:22,600 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33. after waiting 0 ms 2023-02-16 18:01:22,600 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33. 2023-02-16 18:01:22,601 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33. 2023-02-16 18:01:22,601 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for e155df5ccc3da2f833eca9746ce9ba33: 2023-02-16 18:01:22,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45927] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 18:01:22,961 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:22,962 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 19e292fb23dca311f01841f682b38f19, disabling compactions & flushes 2023-02-16 18:01:22,962 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19. 2023-02-16 18:01:22,962 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19. 2023-02-16 18:01:22,962 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19. after waiting 0 ms 2023-02-16 18:01:22,962 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19. 2023-02-16 18:01:22,962 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19. 2023-02-16 18:01:22,962 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 19e292fb23dca311f01841f682b38f19: 2023-02-16 18:01:22,965 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 18:01:22,966 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676570482966"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570482966"}]},"ts":"1676570482966"} 2023-02-16 18:01:22,966 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676570482095.3eb4596533e4744167c987c3f9928464.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570482966"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570482966"}]},"ts":"1676570482966"} 2023-02-16 18:01:22,966 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676570482095.ff112adcde372b676d79e75223744fae.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570482966"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570482966"}]},"ts":"1676570482966"} 2023-02-16 18:01:22,966 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676570482095.eb6d74bacfba537526abbce930880639.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570482966"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570482966"}]},"ts":"1676570482966"} 2023-02-16 18:01:22,966 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570482966"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570482966"}]},"ts":"1676570482966"} 2023-02-16 18:01:22,966 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676570482095.d429632777f89bb78e78ce013de08e64.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570482966"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570482966"}]},"ts":"1676570482966"} 2023-02-16 18:01:22,966 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570482966"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570482966"}]},"ts":"1676570482966"} 2023-02-16 18:01:22,966 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570482966"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570482966"}]},"ts":"1676570482966"} 2023-02-16 18:01:22,966 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676570482966"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570482966"}]},"ts":"1676570482966"} 2023-02-16 18:01:22,966 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570482966"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570482966"}]},"ts":"1676570482966"} 2023-02-16 18:01:22,969 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-16 18:01:22,971 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 18:01:22,971 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676570482971"}]},"ts":"1676570482971"} 2023-02-16 18:01:22,973 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-16 18:01:22,976 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 18:01:22,985 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 18:01:22,985 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 18:01:22,986 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 18:01:22,986 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f6fea7abf2b32dbe67a267c0cf01e593, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=19e292fb23dca311f01841f682b38f19, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3eb4596533e4744167c987c3f9928464, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=eb6d74bacfba537526abbce930880639, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ff112adcde372b676d79e75223744fae, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=da4e4d853fcab29265a5ca41991cbfb7, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d429632777f89bb78e78ce013de08e64, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8fdec3876078f55081787f24f961828a, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=31afd44b71d5642a373135dee5b626ea, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e155df5ccc3da2f833eca9746ce9ba33, ASSIGN}] 2023-02-16 18:01:22,989 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=19e292fb23dca311f01841f682b38f19, ASSIGN 2023-02-16 18:01:22,989 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f6fea7abf2b32dbe67a267c0cf01e593, ASSIGN 2023-02-16 18:01:22,989 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=eb6d74bacfba537526abbce930880639, ASSIGN 2023-02-16 18:01:22,989 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ff112adcde372b676d79e75223744fae, ASSIGN 2023-02-16 18:01:22,990 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=ff112adcde372b676d79e75223744fae, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42581,1676570480748; forceNewPlan=false, retain=false 2023-02-16 18:01:22,990 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=f6fea7abf2b32dbe67a267c0cf01e593, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42581,1676570480748; forceNewPlan=false, retain=false 2023-02-16 18:01:22,990 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e155df5ccc3da2f833eca9746ce9ba33, ASSIGN 2023-02-16 18:01:22,990 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=eb6d74bacfba537526abbce930880639, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40551,1676570480716; forceNewPlan=false, retain=false 2023-02-16 18:01:22,990 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=19e292fb23dca311f01841f682b38f19, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40551,1676570480716; forceNewPlan=false, retain=false 2023-02-16 18:01:22,992 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=31afd44b71d5642a373135dee5b626ea, ASSIGN 2023-02-16 18:01:22,992 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8fdec3876078f55081787f24f961828a, ASSIGN 2023-02-16 18:01:22,993 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d429632777f89bb78e78ce013de08e64, ASSIGN 2023-02-16 18:01:22,993 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e155df5ccc3da2f833eca9746ce9ba33, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42581,1676570480748; forceNewPlan=false, retain=false 2023-02-16 18:01:22,993 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=da4e4d853fcab29265a5ca41991cbfb7, ASSIGN 2023-02-16 18:01:22,994 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=31afd44b71d5642a373135dee5b626ea, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42581,1676570480748; forceNewPlan=false, retain=false 2023-02-16 18:01:22,994 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=8fdec3876078f55081787f24f961828a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40551,1676570480716; forceNewPlan=false, retain=false 2023-02-16 18:01:22,994 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=d429632777f89bb78e78ce013de08e64, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40551,1676570480716; forceNewPlan=false, retain=false 2023-02-16 18:01:22,994 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3eb4596533e4744167c987c3f9928464, ASSIGN 2023-02-16 18:01:22,995 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=da4e4d853fcab29265a5ca41991cbfb7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42581,1676570480748; forceNewPlan=false, retain=false 2023-02-16 18:01:22,995 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=3eb4596533e4744167c987c3f9928464, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40551,1676570480716; forceNewPlan=false, retain=false 2023-02-16 18:01:23,141 INFO [jenkins-hbase4:45927] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-16 18:01:23,144 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=f6fea7abf2b32dbe67a267c0cf01e593, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:23,144 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=31afd44b71d5642a373135dee5b626ea, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:23,144 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=ff112adcde372b676d79e75223744fae, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:23,145 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570483144"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570483144"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570483144"}]},"ts":"1676570483144"} 2023-02-16 18:01:23,144 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=da4e4d853fcab29265a5ca41991cbfb7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:23,145 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676570482095.ff112adcde372b676d79e75223744fae.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570483144"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570483144"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570483144"}]},"ts":"1676570483144"} 2023-02-16 18:01:23,145 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570483144"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570483144"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570483144"}]},"ts":"1676570483144"} 2023-02-16 18:01:23,144 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=e155df5ccc3da2f833eca9746ce9ba33, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:23,145 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676570483144"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570483144"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570483144"}]},"ts":"1676570483144"} 2023-02-16 18:01:23,145 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676570483144"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570483144"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570483144"}]},"ts":"1676570483144"} 2023-02-16 18:01:23,147 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=19, state=RUNNABLE; OpenRegionProcedure 31afd44b71d5642a373135dee5b626ea, server=jenkins-hbase4.apache.org,42581,1676570480748}] 2023-02-16 18:01:23,147 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=15, state=RUNNABLE; OpenRegionProcedure ff112adcde372b676d79e75223744fae, server=jenkins-hbase4.apache.org,42581,1676570480748}] 2023-02-16 18:01:23,149 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=16, state=RUNNABLE; OpenRegionProcedure da4e4d853fcab29265a5ca41991cbfb7, server=jenkins-hbase4.apache.org,42581,1676570480748}] 2023-02-16 18:01:23,149 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=11, state=RUNNABLE; OpenRegionProcedure f6fea7abf2b32dbe67a267c0cf01e593, server=jenkins-hbase4.apache.org,42581,1676570480748}] 2023-02-16 18:01:23,151 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=20, state=RUNNABLE; OpenRegionProcedure e155df5ccc3da2f833eca9746ce9ba33, server=jenkins-hbase4.apache.org,42581,1676570480748}] 2023-02-16 18:01:23,153 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=3eb4596533e4744167c987c3f9928464, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:23,154 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676570482095.3eb4596533e4744167c987c3f9928464.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570483152"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570483152"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570483152"}]},"ts":"1676570483152"} 2023-02-16 18:01:23,155 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=d429632777f89bb78e78ce013de08e64, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:23,155 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676570482095.d429632777f89bb78e78ce013de08e64.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570483154"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570483154"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570483154"}]},"ts":"1676570483154"} 2023-02-16 18:01:23,157 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=13, state=RUNNABLE; OpenRegionProcedure 3eb4596533e4744167c987c3f9928464, server=jenkins-hbase4.apache.org,40551,1676570480716}] 2023-02-16 18:01:23,158 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=8fdec3876078f55081787f24f961828a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:23,158 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=19e292fb23dca311f01841f682b38f19, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:23,158 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570483157"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570483157"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570483157"}]},"ts":"1676570483157"} 2023-02-16 18:01:23,158 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570483158"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570483158"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570483158"}]},"ts":"1676570483158"} 2023-02-16 18:01:23,158 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=eb6d74bacfba537526abbce930880639, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:23,158 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676570482095.eb6d74bacfba537526abbce930880639.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570483158"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570483158"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570483158"}]},"ts":"1676570483158"} 2023-02-16 18:01:23,166 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=17, state=RUNNABLE; OpenRegionProcedure d429632777f89bb78e78ce013de08e64, server=jenkins-hbase4.apache.org,40551,1676570480716}] 2023-02-16 18:01:23,167 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=18, state=RUNNABLE; OpenRegionProcedure 8fdec3876078f55081787f24f961828a, server=jenkins-hbase4.apache.org,40551,1676570480716}] 2023-02-16 18:01:23,168 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=12, state=RUNNABLE; OpenRegionProcedure 19e292fb23dca311f01841f682b38f19, server=jenkins-hbase4.apache.org,40551,1676570480716}] 2023-02-16 18:01:23,169 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=14, state=RUNNABLE; OpenRegionProcedure eb6d74bacfba537526abbce930880639, server=jenkins-hbase4.apache.org,40551,1676570480716}] 2023-02-16 18:01:23,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45927] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 18:01:23,299 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:23,299 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 18:01:23,302 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40226, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 18:01:23,306 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33. 2023-02-16 18:01:23,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e155df5ccc3da2f833eca9746ce9ba33, NAME => 'testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-16 18:01:23,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e155df5ccc3da2f833eca9746ce9ba33 2023-02-16 18:01:23,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:23,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e155df5ccc3da2f833eca9746ce9ba33 2023-02-16 18:01:23,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e155df5ccc3da2f833eca9746ce9ba33 2023-02-16 18:01:23,308 INFO [StoreOpener-e155df5ccc3da2f833eca9746ce9ba33-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e155df5ccc3da2f833eca9746ce9ba33 2023-02-16 18:01:23,309 DEBUG [StoreOpener-e155df5ccc3da2f833eca9746ce9ba33-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/e155df5ccc3da2f833eca9746ce9ba33/f1 2023-02-16 18:01:23,309 DEBUG [StoreOpener-e155df5ccc3da2f833eca9746ce9ba33-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/e155df5ccc3da2f833eca9746ce9ba33/f1 2023-02-16 18:01:23,310 INFO [StoreOpener-e155df5ccc3da2f833eca9746ce9ba33-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e155df5ccc3da2f833eca9746ce9ba33 columnFamilyName f1 2023-02-16 18:01:23,310 INFO [StoreOpener-e155df5ccc3da2f833eca9746ce9ba33-1] regionserver.HStore(310): Store=e155df5ccc3da2f833eca9746ce9ba33/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:23,310 INFO [StoreOpener-e155df5ccc3da2f833eca9746ce9ba33-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e155df5ccc3da2f833eca9746ce9ba33 2023-02-16 18:01:23,312 DEBUG [StoreOpener-e155df5ccc3da2f833eca9746ce9ba33-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/e155df5ccc3da2f833eca9746ce9ba33/f2 2023-02-16 18:01:23,312 DEBUG [StoreOpener-e155df5ccc3da2f833eca9746ce9ba33-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/e155df5ccc3da2f833eca9746ce9ba33/f2 2023-02-16 18:01:23,312 INFO [StoreOpener-e155df5ccc3da2f833eca9746ce9ba33-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e155df5ccc3da2f833eca9746ce9ba33 columnFamilyName f2 2023-02-16 18:01:23,313 INFO [StoreOpener-e155df5ccc3da2f833eca9746ce9ba33-1] regionserver.HStore(310): Store=e155df5ccc3da2f833eca9746ce9ba33/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:23,313 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19. 2023-02-16 18:01:23,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 19e292fb23dca311f01841f682b38f19, NAME => 'testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-16 18:01:23,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 19e292fb23dca311f01841f682b38f19 2023-02-16 18:01:23,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:23,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 19e292fb23dca311f01841f682b38f19 2023-02-16 18:01:23,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 19e292fb23dca311f01841f682b38f19 2023-02-16 18:01:23,315 INFO [StoreOpener-19e292fb23dca311f01841f682b38f19-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 19e292fb23dca311f01841f682b38f19 2023-02-16 18:01:23,316 DEBUG [StoreOpener-19e292fb23dca311f01841f682b38f19-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/19e292fb23dca311f01841f682b38f19/f1 2023-02-16 18:01:23,316 DEBUG [StoreOpener-19e292fb23dca311f01841f682b38f19-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/19e292fb23dca311f01841f682b38f19/f1 2023-02-16 18:01:23,317 INFO [StoreOpener-19e292fb23dca311f01841f682b38f19-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 19e292fb23dca311f01841f682b38f19 columnFamilyName f1 2023-02-16 18:01:23,317 INFO [StoreOpener-19e292fb23dca311f01841f682b38f19-1] regionserver.HStore(310): Store=19e292fb23dca311f01841f682b38f19/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:23,317 INFO [StoreOpener-19e292fb23dca311f01841f682b38f19-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 19e292fb23dca311f01841f682b38f19 2023-02-16 18:01:23,319 DEBUG [StoreOpener-19e292fb23dca311f01841f682b38f19-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/19e292fb23dca311f01841f682b38f19/f2 2023-02-16 18:01:23,319 DEBUG [StoreOpener-19e292fb23dca311f01841f682b38f19-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/19e292fb23dca311f01841f682b38f19/f2 2023-02-16 18:01:23,319 INFO [StoreOpener-19e292fb23dca311f01841f682b38f19-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 19e292fb23dca311f01841f682b38f19 columnFamilyName f2 2023-02-16 18:01:23,320 INFO [StoreOpener-19e292fb23dca311f01841f682b38f19-1] regionserver.HStore(310): Store=19e292fb23dca311f01841f682b38f19/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:23,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/19e292fb23dca311f01841f682b38f19 2023-02-16 18:01:23,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/e155df5ccc3da2f833eca9746ce9ba33 2023-02-16 18:01:23,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/e155df5ccc3da2f833eca9746ce9ba33 2023-02-16 18:01:23,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/19e292fb23dca311f01841f682b38f19 2023-02-16 18:01:23,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:23,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:23,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e155df5ccc3da2f833eca9746ce9ba33 2023-02-16 18:01:23,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 19e292fb23dca311f01841f682b38f19 2023-02-16 18:01:23,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/e155df5ccc3da2f833eca9746ce9ba33/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:23,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/19e292fb23dca311f01841f682b38f19/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:23,327 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e155df5ccc3da2f833eca9746ce9ba33; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64147775, jitterRate=-0.04412366449832916}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:23,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e155df5ccc3da2f833eca9746ce9ba33: 2023-02-16 18:01:23,328 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 19e292fb23dca311f01841f682b38f19; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62657392, jitterRate=-0.06633210182189941}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:23,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 19e292fb23dca311f01841f682b38f19: 2023-02-16 18:01:23,328 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19., pid=29, masterSystemTime=1676570483310 2023-02-16 18:01:23,329 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33., pid=25, masterSystemTime=1676570483299 2023-02-16 18:01:23,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19. 2023-02-16 18:01:23,332 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19. 2023-02-16 18:01:23,332 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676570482095.eb6d74bacfba537526abbce930880639. 2023-02-16 18:01:23,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => eb6d74bacfba537526abbce930880639, NAME => 'testWithMapReduce,g\xA7\xA7,1676570482095.eb6d74bacfba537526abbce930880639.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-16 18:01:23,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce eb6d74bacfba537526abbce930880639 2023-02-16 18:01:23,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676570482095.eb6d74bacfba537526abbce930880639.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:23,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for eb6d74bacfba537526abbce930880639 2023-02-16 18:01:23,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for eb6d74bacfba537526abbce930880639 2023-02-16 18:01:23,333 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=19e292fb23dca311f01841f682b38f19, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:23,333 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570483333"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676570483333"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676570483333"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676570483333"}]},"ts":"1676570483333"} 2023-02-16 18:01:23,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33. 2023-02-16 18:01:23,334 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33. 2023-02-16 18:01:23,334 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae. 2023-02-16 18:01:23,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ff112adcde372b676d79e75223744fae, NAME => 'testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-16 18:01:23,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce ff112adcde372b676d79e75223744fae 2023-02-16 18:01:23,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:23,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ff112adcde372b676d79e75223744fae 2023-02-16 18:01:23,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ff112adcde372b676d79e75223744fae 2023-02-16 18:01:23,335 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=e155df5ccc3da2f833eca9746ce9ba33, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:23,335 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676570483335"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676570483335"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676570483335"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676570483335"}]},"ts":"1676570483335"} 2023-02-16 18:01:23,336 INFO [StoreOpener-eb6d74bacfba537526abbce930880639-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region eb6d74bacfba537526abbce930880639 2023-02-16 18:01:23,336 INFO [StoreOpener-ff112adcde372b676d79e75223744fae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ff112adcde372b676d79e75223744fae 2023-02-16 18:01:23,337 DEBUG [StoreOpener-eb6d74bacfba537526abbce930880639-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/eb6d74bacfba537526abbce930880639/f1 2023-02-16 18:01:23,337 DEBUG [StoreOpener-eb6d74bacfba537526abbce930880639-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/eb6d74bacfba537526abbce930880639/f1 2023-02-16 18:01:23,337 DEBUG [StoreOpener-ff112adcde372b676d79e75223744fae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/ff112adcde372b676d79e75223744fae/f1 2023-02-16 18:01:23,338 DEBUG [StoreOpener-ff112adcde372b676d79e75223744fae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/ff112adcde372b676d79e75223744fae/f1 2023-02-16 18:01:23,338 INFO [StoreOpener-ff112adcde372b676d79e75223744fae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff112adcde372b676d79e75223744fae columnFamilyName f1 2023-02-16 18:01:23,338 INFO [StoreOpener-eb6d74bacfba537526abbce930880639-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eb6d74bacfba537526abbce930880639 columnFamilyName f1 2023-02-16 18:01:23,338 INFO [StoreOpener-ff112adcde372b676d79e75223744fae-1] regionserver.HStore(310): Store=ff112adcde372b676d79e75223744fae/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:23,338 INFO [StoreOpener-eb6d74bacfba537526abbce930880639-1] regionserver.HStore(310): Store=eb6d74bacfba537526abbce930880639/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:23,338 INFO [StoreOpener-ff112adcde372b676d79e75223744fae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ff112adcde372b676d79e75223744fae 2023-02-16 18:01:23,339 INFO [StoreOpener-eb6d74bacfba537526abbce930880639-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region eb6d74bacfba537526abbce930880639 2023-02-16 18:01:23,340 DEBUG [StoreOpener-ff112adcde372b676d79e75223744fae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/ff112adcde372b676d79e75223744fae/f2 2023-02-16 18:01:23,340 DEBUG [StoreOpener-ff112adcde372b676d79e75223744fae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/ff112adcde372b676d79e75223744fae/f2 2023-02-16 18:01:23,340 DEBUG [StoreOpener-eb6d74bacfba537526abbce930880639-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/eb6d74bacfba537526abbce930880639/f2 2023-02-16 18:01:23,340 DEBUG [StoreOpener-eb6d74bacfba537526abbce930880639-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/eb6d74bacfba537526abbce930880639/f2 2023-02-16 18:01:23,340 INFO [StoreOpener-ff112adcde372b676d79e75223744fae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff112adcde372b676d79e75223744fae columnFamilyName f2 2023-02-16 18:01:23,340 INFO [StoreOpener-eb6d74bacfba537526abbce930880639-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eb6d74bacfba537526abbce930880639 columnFamilyName f2 2023-02-16 18:01:23,340 INFO [StoreOpener-ff112adcde372b676d79e75223744fae-1] regionserver.HStore(310): Store=ff112adcde372b676d79e75223744fae/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:23,341 INFO [StoreOpener-eb6d74bacfba537526abbce930880639-1] regionserver.HStore(310): Store=eb6d74bacfba537526abbce930880639/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:23,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/ff112adcde372b676d79e75223744fae 2023-02-16 18:01:23,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/ff112adcde372b676d79e75223744fae 2023-02-16 18:01:23,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/eb6d74bacfba537526abbce930880639 2023-02-16 18:01:23,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/eb6d74bacfba537526abbce930880639 2023-02-16 18:01:23,344 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=12 2023-02-16 18:01:23,344 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=12, state=SUCCESS; OpenRegionProcedure 19e292fb23dca311f01841f682b38f19, server=jenkins-hbase4.apache.org,40551,1676570480716 in 172 msec 2023-02-16 18:01:23,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:23,345 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=20 2023-02-16 18:01:23,345 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=20, state=SUCCESS; OpenRegionProcedure e155df5ccc3da2f833eca9746ce9ba33, server=jenkins-hbase4.apache.org,42581,1676570480748 in 192 msec 2023-02-16 18:01:23,346 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=19e292fb23dca311f01841f682b38f19, ASSIGN in 358 msec 2023-02-16 18:01:23,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:23,347 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e155df5ccc3da2f833eca9746ce9ba33, ASSIGN in 359 msec 2023-02-16 18:01:23,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for eb6d74bacfba537526abbce930880639 2023-02-16 18:01:23,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ff112adcde372b676d79e75223744fae 2023-02-16 18:01:23,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/eb6d74bacfba537526abbce930880639/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:23,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/ff112adcde372b676d79e75223744fae/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:23,350 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened eb6d74bacfba537526abbce930880639; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70617492, jitterRate=0.052282631397247314}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:23,350 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ff112adcde372b676d79e75223744fae; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67518098, jitterRate=0.006098061800003052}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:23,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for eb6d74bacfba537526abbce930880639: 2023-02-16 18:01:23,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ff112adcde372b676d79e75223744fae: 2023-02-16 18:01:23,351 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676570482095.eb6d74bacfba537526abbce930880639., pid=30, masterSystemTime=1676570483310 2023-02-16 18:01:23,352 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae., pid=22, masterSystemTime=1676570483299 2023-02-16 18:01:23,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676570482095.eb6d74bacfba537526abbce930880639. 2023-02-16 18:01:23,353 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676570482095.eb6d74bacfba537526abbce930880639. 2023-02-16 18:01:23,353 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a. 2023-02-16 18:01:23,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8fdec3876078f55081787f24f961828a, NAME => 'testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-16 18:01:23,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 8fdec3876078f55081787f24f961828a 2023-02-16 18:01:23,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:23,353 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=eb6d74bacfba537526abbce930880639, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:23,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8fdec3876078f55081787f24f961828a 2023-02-16 18:01:23,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8fdec3876078f55081787f24f961828a 2023-02-16 18:01:23,354 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676570482095.eb6d74bacfba537526abbce930880639.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570483353"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676570483353"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676570483353"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676570483353"}]},"ts":"1676570483353"} 2023-02-16 18:01:23,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae. 2023-02-16 18:01:23,354 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae. 2023-02-16 18:01:23,354 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593. 2023-02-16 18:01:23,354 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=ff112adcde372b676d79e75223744fae, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:23,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f6fea7abf2b32dbe67a267c0cf01e593, NAME => 'testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-16 18:01:23,355 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676570482095.ff112adcde372b676d79e75223744fae.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570483354"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676570483354"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676570483354"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676570483354"}]},"ts":"1676570483354"} 2023-02-16 18:01:23,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce f6fea7abf2b32dbe67a267c0cf01e593 2023-02-16 18:01:23,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:23,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f6fea7abf2b32dbe67a267c0cf01e593 2023-02-16 18:01:23,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f6fea7abf2b32dbe67a267c0cf01e593 2023-02-16 18:01:23,356 INFO [StoreOpener-8fdec3876078f55081787f24f961828a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8fdec3876078f55081787f24f961828a 2023-02-16 18:01:23,357 INFO [StoreOpener-f6fea7abf2b32dbe67a267c0cf01e593-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f6fea7abf2b32dbe67a267c0cf01e593 2023-02-16 18:01:23,358 DEBUG [StoreOpener-8fdec3876078f55081787f24f961828a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/8fdec3876078f55081787f24f961828a/f1 2023-02-16 18:01:23,359 DEBUG [StoreOpener-8fdec3876078f55081787f24f961828a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/8fdec3876078f55081787f24f961828a/f1 2023-02-16 18:01:23,359 DEBUG [StoreOpener-f6fea7abf2b32dbe67a267c0cf01e593-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/f6fea7abf2b32dbe67a267c0cf01e593/f1 2023-02-16 18:01:23,359 DEBUG [StoreOpener-f6fea7abf2b32dbe67a267c0cf01e593-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/f6fea7abf2b32dbe67a267c0cf01e593/f1 2023-02-16 18:01:23,359 INFO [StoreOpener-f6fea7abf2b32dbe67a267c0cf01e593-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f6fea7abf2b32dbe67a267c0cf01e593 columnFamilyName f1 2023-02-16 18:01:23,360 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=14 2023-02-16 18:01:23,360 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=14, state=SUCCESS; OpenRegionProcedure eb6d74bacfba537526abbce930880639, server=jenkins-hbase4.apache.org,40551,1676570480716 in 188 msec 2023-02-16 18:01:23,360 INFO [StoreOpener-8fdec3876078f55081787f24f961828a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8fdec3876078f55081787f24f961828a columnFamilyName f1 2023-02-16 18:01:23,360 INFO [StoreOpener-f6fea7abf2b32dbe67a267c0cf01e593-1] regionserver.HStore(310): Store=f6fea7abf2b32dbe67a267c0cf01e593/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:23,360 INFO [StoreOpener-f6fea7abf2b32dbe67a267c0cf01e593-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f6fea7abf2b32dbe67a267c0cf01e593 2023-02-16 18:01:23,361 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=15 2023-02-16 18:01:23,361 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=15, state=SUCCESS; OpenRegionProcedure ff112adcde372b676d79e75223744fae, server=jenkins-hbase4.apache.org,42581,1676570480748 in 212 msec 2023-02-16 18:01:23,361 INFO [StoreOpener-8fdec3876078f55081787f24f961828a-1] regionserver.HStore(310): Store=8fdec3876078f55081787f24f961828a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:23,361 INFO [StoreOpener-8fdec3876078f55081787f24f961828a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8fdec3876078f55081787f24f961828a 2023-02-16 18:01:23,361 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=eb6d74bacfba537526abbce930880639, ASSIGN in 374 msec 2023-02-16 18:01:23,362 DEBUG [StoreOpener-f6fea7abf2b32dbe67a267c0cf01e593-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/f6fea7abf2b32dbe67a267c0cf01e593/f2 2023-02-16 18:01:23,362 DEBUG [StoreOpener-f6fea7abf2b32dbe67a267c0cf01e593-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/f6fea7abf2b32dbe67a267c0cf01e593/f2 2023-02-16 18:01:23,363 INFO [StoreOpener-f6fea7abf2b32dbe67a267c0cf01e593-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f6fea7abf2b32dbe67a267c0cf01e593 columnFamilyName f2 2023-02-16 18:01:23,363 INFO [StoreOpener-f6fea7abf2b32dbe67a267c0cf01e593-1] regionserver.HStore(310): Store=f6fea7abf2b32dbe67a267c0cf01e593/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:23,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/f6fea7abf2b32dbe67a267c0cf01e593 2023-02-16 18:01:23,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/f6fea7abf2b32dbe67a267c0cf01e593 2023-02-16 18:01:23,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:23,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f6fea7abf2b32dbe67a267c0cf01e593 2023-02-16 18:01:23,370 DEBUG [StoreOpener-8fdec3876078f55081787f24f961828a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/8fdec3876078f55081787f24f961828a/f2 2023-02-16 18:01:23,371 DEBUG [StoreOpener-8fdec3876078f55081787f24f961828a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/8fdec3876078f55081787f24f961828a/f2 2023-02-16 18:01:23,371 INFO [StoreOpener-8fdec3876078f55081787f24f961828a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8fdec3876078f55081787f24f961828a columnFamilyName f2 2023-02-16 18:01:23,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/f6fea7abf2b32dbe67a267c0cf01e593/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:23,373 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f6fea7abf2b32dbe67a267c0cf01e593; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74298478, jitterRate=0.10713359713554382}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:23,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f6fea7abf2b32dbe67a267c0cf01e593: 2023-02-16 18:01:23,374 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593., pid=24, masterSystemTime=1676570483299 2023-02-16 18:01:23,375 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ff112adcde372b676d79e75223744fae, ASSIGN in 375 msec 2023-02-16 18:01:23,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593. 2023-02-16 18:01:23,376 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593. 2023-02-16 18:01:23,376 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7. 2023-02-16 18:01:23,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => da4e4d853fcab29265a5ca41991cbfb7, NAME => 'testWithMapReduce,m\xED\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-16 18:01:23,377 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=f6fea7abf2b32dbe67a267c0cf01e593, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:23,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce da4e4d853fcab29265a5ca41991cbfb7 2023-02-16 18:01:23,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:23,377 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676570483377"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676570483377"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676570483377"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676570483377"}]},"ts":"1676570483377"} 2023-02-16 18:01:23,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for da4e4d853fcab29265a5ca41991cbfb7 2023-02-16 18:01:23,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for da4e4d853fcab29265a5ca41991cbfb7 2023-02-16 18:01:23,378 INFO [StoreOpener-8fdec3876078f55081787f24f961828a-1] regionserver.HStore(310): Store=8fdec3876078f55081787f24f961828a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:23,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/8fdec3876078f55081787f24f961828a 2023-02-16 18:01:23,379 INFO [StoreOpener-da4e4d853fcab29265a5ca41991cbfb7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region da4e4d853fcab29265a5ca41991cbfb7 2023-02-16 18:01:23,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/8fdec3876078f55081787f24f961828a 2023-02-16 18:01:23,381 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=11 2023-02-16 18:01:23,381 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=11, state=SUCCESS; OpenRegionProcedure f6fea7abf2b32dbe67a267c0cf01e593, server=jenkins-hbase4.apache.org,42581,1676570480748 in 230 msec 2023-02-16 18:01:23,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:23,382 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f6fea7abf2b32dbe67a267c0cf01e593, ASSIGN in 395 msec 2023-02-16 18:01:23,384 DEBUG [StoreOpener-da4e4d853fcab29265a5ca41991cbfb7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/da4e4d853fcab29265a5ca41991cbfb7/f1 2023-02-16 18:01:23,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8fdec3876078f55081787f24f961828a 2023-02-16 18:01:23,384 DEBUG [StoreOpener-da4e4d853fcab29265a5ca41991cbfb7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/da4e4d853fcab29265a5ca41991cbfb7/f1 2023-02-16 18:01:23,384 INFO [StoreOpener-da4e4d853fcab29265a5ca41991cbfb7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region da4e4d853fcab29265a5ca41991cbfb7 columnFamilyName f1 2023-02-16 18:01:23,385 INFO [StoreOpener-da4e4d853fcab29265a5ca41991cbfb7-1] regionserver.HStore(310): Store=da4e4d853fcab29265a5ca41991cbfb7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:23,385 INFO [StoreOpener-da4e4d853fcab29265a5ca41991cbfb7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region da4e4d853fcab29265a5ca41991cbfb7 2023-02-16 18:01:23,387 DEBUG [StoreOpener-da4e4d853fcab29265a5ca41991cbfb7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/da4e4d853fcab29265a5ca41991cbfb7/f2 2023-02-16 18:01:23,387 DEBUG [StoreOpener-da4e4d853fcab29265a5ca41991cbfb7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/da4e4d853fcab29265a5ca41991cbfb7/f2 2023-02-16 18:01:23,387 INFO [StoreOpener-da4e4d853fcab29265a5ca41991cbfb7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region da4e4d853fcab29265a5ca41991cbfb7 columnFamilyName f2 2023-02-16 18:01:23,388 INFO [StoreOpener-da4e4d853fcab29265a5ca41991cbfb7-1] regionserver.HStore(310): Store=da4e4d853fcab29265a5ca41991cbfb7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:23,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/8fdec3876078f55081787f24f961828a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:23,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/da4e4d853fcab29265a5ca41991cbfb7 2023-02-16 18:01:23,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/da4e4d853fcab29265a5ca41991cbfb7 2023-02-16 18:01:23,389 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8fdec3876078f55081787f24f961828a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75470855, jitterRate=0.12460337579250336}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:23,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8fdec3876078f55081787f24f961828a: 2023-02-16 18:01:23,390 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a., pid=28, masterSystemTime=1676570483310 2023-02-16 18:01:23,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:23,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a. 2023-02-16 18:01:23,392 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a. 2023-02-16 18:01:23,392 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676570482095.3eb4596533e4744167c987c3f9928464. 2023-02-16 18:01:23,392 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=8fdec3876078f55081787f24f961828a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:23,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3eb4596533e4744167c987c3f9928464, NAME => 'testWithMapReduce,d\x84\x84,1676570482095.3eb4596533e4744167c987c3f9928464.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-16 18:01:23,392 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570483392"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676570483392"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676570483392"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676570483392"}]},"ts":"1676570483392"} 2023-02-16 18:01:23,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 3eb4596533e4744167c987c3f9928464 2023-02-16 18:01:23,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676570482095.3eb4596533e4744167c987c3f9928464.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:23,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3eb4596533e4744167c987c3f9928464 2023-02-16 18:01:23,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3eb4596533e4744167c987c3f9928464 2023-02-16 18:01:23,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for da4e4d853fcab29265a5ca41991cbfb7 2023-02-16 18:01:23,396 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=18 2023-02-16 18:01:23,396 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=18, state=SUCCESS; OpenRegionProcedure 8fdec3876078f55081787f24f961828a, server=jenkins-hbase4.apache.org,40551,1676570480716 in 227 msec 2023-02-16 18:01:23,397 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=8fdec3876078f55081787f24f961828a, ASSIGN in 410 msec 2023-02-16 18:01:23,407 INFO [StoreOpener-3eb4596533e4744167c987c3f9928464-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3eb4596533e4744167c987c3f9928464 2023-02-16 18:01:23,409 DEBUG [StoreOpener-3eb4596533e4744167c987c3f9928464-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/3eb4596533e4744167c987c3f9928464/f1 2023-02-16 18:01:23,409 DEBUG [StoreOpener-3eb4596533e4744167c987c3f9928464-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/3eb4596533e4744167c987c3f9928464/f1 2023-02-16 18:01:23,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/da4e4d853fcab29265a5ca41991cbfb7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:23,410 INFO [StoreOpener-3eb4596533e4744167c987c3f9928464-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3eb4596533e4744167c987c3f9928464 columnFamilyName f1 2023-02-16 18:01:23,410 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened da4e4d853fcab29265a5ca41991cbfb7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74868890, jitterRate=0.11563339829444885}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:23,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for da4e4d853fcab29265a5ca41991cbfb7: 2023-02-16 18:01:23,410 INFO [StoreOpener-3eb4596533e4744167c987c3f9928464-1] regionserver.HStore(310): Store=3eb4596533e4744167c987c3f9928464/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:23,411 INFO [StoreOpener-3eb4596533e4744167c987c3f9928464-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3eb4596533e4744167c987c3f9928464 2023-02-16 18:01:23,411 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7., pid=23, masterSystemTime=1676570483299 2023-02-16 18:01:23,413 DEBUG [StoreOpener-3eb4596533e4744167c987c3f9928464-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/3eb4596533e4744167c987c3f9928464/f2 2023-02-16 18:01:23,414 DEBUG [StoreOpener-3eb4596533e4744167c987c3f9928464-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/3eb4596533e4744167c987c3f9928464/f2 2023-02-16 18:01:23,414 INFO [StoreOpener-3eb4596533e4744167c987c3f9928464-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3eb4596533e4744167c987c3f9928464 columnFamilyName f2 2023-02-16 18:01:23,415 INFO [StoreOpener-3eb4596533e4744167c987c3f9928464-1] regionserver.HStore(310): Store=3eb4596533e4744167c987c3f9928464/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:23,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7. 2023-02-16 18:01:23,416 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7. 2023-02-16 18:01:23,416 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea. 2023-02-16 18:01:23,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 31afd44b71d5642a373135dee5b626ea, NAME => 'testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-16 18:01:23,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 31afd44b71d5642a373135dee5b626ea 2023-02-16 18:01:23,416 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=da4e4d853fcab29265a5ca41991cbfb7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:23,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:23,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/3eb4596533e4744167c987c3f9928464 2023-02-16 18:01:23,416 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570483416"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676570483416"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676570483416"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676570483416"}]},"ts":"1676570483416"} 2023-02-16 18:01:23,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/3eb4596533e4744167c987c3f9928464 2023-02-16 18:01:23,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 31afd44b71d5642a373135dee5b626ea 2023-02-16 18:01:23,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 31afd44b71d5642a373135dee5b626ea 2023-02-16 18:01:23,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:23,421 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=16 2023-02-16 18:01:23,421 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=16, state=SUCCESS; OpenRegionProcedure da4e4d853fcab29265a5ca41991cbfb7, server=jenkins-hbase4.apache.org,42581,1676570480748 in 271 msec 2023-02-16 18:01:23,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3eb4596533e4744167c987c3f9928464 2023-02-16 18:01:23,423 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=da4e4d853fcab29265a5ca41991cbfb7, ASSIGN in 435 msec 2023-02-16 18:01:23,425 INFO [StoreOpener-31afd44b71d5642a373135dee5b626ea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 31afd44b71d5642a373135dee5b626ea 2023-02-16 18:01:23,427 DEBUG [StoreOpener-31afd44b71d5642a373135dee5b626ea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/31afd44b71d5642a373135dee5b626ea/f1 2023-02-16 18:01:23,427 DEBUG [StoreOpener-31afd44b71d5642a373135dee5b626ea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/31afd44b71d5642a373135dee5b626ea/f1 2023-02-16 18:01:23,427 INFO [StoreOpener-31afd44b71d5642a373135dee5b626ea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 31afd44b71d5642a373135dee5b626ea columnFamilyName f1 2023-02-16 18:01:23,428 INFO [StoreOpener-31afd44b71d5642a373135dee5b626ea-1] regionserver.HStore(310): Store=31afd44b71d5642a373135dee5b626ea/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:23,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/3eb4596533e4744167c987c3f9928464/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:23,429 INFO [StoreOpener-31afd44b71d5642a373135dee5b626ea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 31afd44b71d5642a373135dee5b626ea 2023-02-16 18:01:23,430 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3eb4596533e4744167c987c3f9928464; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59686322, jitterRate=-0.11060449481010437}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:23,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3eb4596533e4744167c987c3f9928464: 2023-02-16 18:01:23,430 DEBUG [StoreOpener-31afd44b71d5642a373135dee5b626ea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/31afd44b71d5642a373135dee5b626ea/f2 2023-02-16 18:01:23,430 DEBUG [StoreOpener-31afd44b71d5642a373135dee5b626ea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/31afd44b71d5642a373135dee5b626ea/f2 2023-02-16 18:01:23,431 INFO [StoreOpener-31afd44b71d5642a373135dee5b626ea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 31afd44b71d5642a373135dee5b626ea columnFamilyName f2 2023-02-16 18:01:23,432 INFO [StoreOpener-31afd44b71d5642a373135dee5b626ea-1] regionserver.HStore(310): Store=31afd44b71d5642a373135dee5b626ea/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:23,433 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676570482095.3eb4596533e4744167c987c3f9928464., pid=26, masterSystemTime=1676570483310 2023-02-16 18:01:23,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/31afd44b71d5642a373135dee5b626ea 2023-02-16 18:01:23,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/31afd44b71d5642a373135dee5b626ea 2023-02-16 18:01:23,435 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=3eb4596533e4744167c987c3f9928464, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:23,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676570482095.3eb4596533e4744167c987c3f9928464. 2023-02-16 18:01:23,436 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676570482095.3eb4596533e4744167c987c3f9928464. 2023-02-16 18:01:23,436 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676570482095.3eb4596533e4744167c987c3f9928464.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570483435"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676570483435"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676570483435"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676570483435"}]},"ts":"1676570483435"} 2023-02-16 18:01:23,436 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676570482095.d429632777f89bb78e78ce013de08e64. 2023-02-16 18:01:23,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d429632777f89bb78e78ce013de08e64, NAME => 'testWithMapReduce,q\x11\x10,1676570482095.d429632777f89bb78e78ce013de08e64.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-16 18:01:23,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce d429632777f89bb78e78ce013de08e64 2023-02-16 18:01:23,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676570482095.d429632777f89bb78e78ce013de08e64.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:23,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d429632777f89bb78e78ce013de08e64 2023-02-16 18:01:23,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d429632777f89bb78e78ce013de08e64 2023-02-16 18:01:23,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:23,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 31afd44b71d5642a373135dee5b626ea 2023-02-16 18:01:23,439 INFO [StoreOpener-d429632777f89bb78e78ce013de08e64-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d429632777f89bb78e78ce013de08e64 2023-02-16 18:01:23,441 DEBUG [StoreOpener-d429632777f89bb78e78ce013de08e64-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/d429632777f89bb78e78ce013de08e64/f1 2023-02-16 18:01:23,441 DEBUG [StoreOpener-d429632777f89bb78e78ce013de08e64-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/d429632777f89bb78e78ce013de08e64/f1 2023-02-16 18:01:23,441 INFO [StoreOpener-d429632777f89bb78e78ce013de08e64-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d429632777f89bb78e78ce013de08e64 columnFamilyName f1 2023-02-16 18:01:23,442 INFO [StoreOpener-d429632777f89bb78e78ce013de08e64-1] regionserver.HStore(310): Store=d429632777f89bb78e78ce013de08e64/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:23,442 INFO [StoreOpener-d429632777f89bb78e78ce013de08e64-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d429632777f89bb78e78ce013de08e64 2023-02-16 18:01:23,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/31afd44b71d5642a373135dee5b626ea/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:23,443 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 31afd44b71d5642a373135dee5b626ea; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69739004, jitterRate=0.039192140102386475}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:23,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 31afd44b71d5642a373135dee5b626ea: 2023-02-16 18:01:23,443 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=13 2023-02-16 18:01:23,443 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=13, state=SUCCESS; OpenRegionProcedure 3eb4596533e4744167c987c3f9928464, server=jenkins-hbase4.apache.org,40551,1676570480716 in 285 msec 2023-02-16 18:01:23,445 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea., pid=21, masterSystemTime=1676570483299 2023-02-16 18:01:23,445 DEBUG [StoreOpener-d429632777f89bb78e78ce013de08e64-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/d429632777f89bb78e78ce013de08e64/f2 2023-02-16 18:01:23,445 DEBUG [StoreOpener-d429632777f89bb78e78ce013de08e64-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/d429632777f89bb78e78ce013de08e64/f2 2023-02-16 18:01:23,445 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3eb4596533e4744167c987c3f9928464, ASSIGN in 457 msec 2023-02-16 18:01:23,445 INFO [StoreOpener-d429632777f89bb78e78ce013de08e64-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d429632777f89bb78e78ce013de08e64 columnFamilyName f2 2023-02-16 18:01:23,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea. 2023-02-16 18:01:23,447 INFO [StoreOpener-d429632777f89bb78e78ce013de08e64-1] regionserver.HStore(310): Store=d429632777f89bb78e78ce013de08e64/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:23,447 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea. 2023-02-16 18:01:23,447 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=31afd44b71d5642a373135dee5b626ea, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:23,447 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570483447"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676570483447"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676570483447"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676570483447"}]},"ts":"1676570483447"} 2023-02-16 18:01:23,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/d429632777f89bb78e78ce013de08e64 2023-02-16 18:01:23,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/d429632777f89bb78e78ce013de08e64 2023-02-16 18:01:23,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:23,452 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=19 2023-02-16 18:01:23,452 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=19, state=SUCCESS; OpenRegionProcedure 31afd44b71d5642a373135dee5b626ea, server=jenkins-hbase4.apache.org,42581,1676570480748 in 303 msec 2023-02-16 18:01:23,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d429632777f89bb78e78ce013de08e64 2023-02-16 18:01:23,453 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=31afd44b71d5642a373135dee5b626ea, ASSIGN in 466 msec 2023-02-16 18:01:23,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/d429632777f89bb78e78ce013de08e64/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:23,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d429632777f89bb78e78ce013de08e64; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64778107, jitterRate=-0.03473098576068878}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:23,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d429632777f89bb78e78ce013de08e64: 2023-02-16 18:01:23,457 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676570482095.d429632777f89bb78e78ce013de08e64., pid=27, masterSystemTime=1676570483310 2023-02-16 18:01:23,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676570482095.d429632777f89bb78e78ce013de08e64. 2023-02-16 18:01:23,461 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676570482095.d429632777f89bb78e78ce013de08e64. 2023-02-16 18:01:23,462 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=d429632777f89bb78e78ce013de08e64, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:23,462 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676570482095.d429632777f89bb78e78ce013de08e64.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676570483461"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676570483461"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676570483461"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676570483461"}]},"ts":"1676570483461"} 2023-02-16 18:01:23,469 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=17 2023-02-16 18:01:23,469 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=17, state=SUCCESS; OpenRegionProcedure d429632777f89bb78e78ce013de08e64, server=jenkins-hbase4.apache.org,40551,1676570480716 in 297 msec 2023-02-16 18:01:23,472 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=10 2023-02-16 18:01:23,472 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d429632777f89bb78e78ce013de08e64, ASSIGN in 483 msec 2023-02-16 18:01:23,474 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 18:01:23,474 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676570483474"}]},"ts":"1676570483474"} 2023-02-16 18:01:23,476 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-16 18:01:23,479 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 18:01:23,482 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 1.3840 sec 2023-02-16 18:01:23,567 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-16 18:01:24,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45927] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 18:01:24,209 INFO [Listener at localhost/46409] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-16 18:01:24,209 DEBUG [Listener at localhost/46409] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-16 18:01:24,209 INFO [Listener at localhost/46409] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 18:01:24,213 INFO [Listener at localhost/46409] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-16 18:01:24,213 INFO [Listener at localhost/46409] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 18:01:24,213 INFO [Listener at localhost/46409] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-16 18:01:24,213 INFO [Listener at localhost/46409] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-16 18:01:24,267 DEBUG [hconnection-0x2f60ba40-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 18:01:24,285 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47186, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 18:01:24,311 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40551] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 10816 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19. 2023-02-16 18:01:24,314 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6760 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae. 2023-02-16 18:01:24,487 INFO [Listener at localhost/46409] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-16 18:01:24,487 INFO [Listener at localhost/46409] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-16 18:01:24,489 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45927] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 18:01:24,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45927] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676570484489 (current time:1676570484489). 2023-02-16 18:01:24,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45927] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-16 18:01:24,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45927] zookeeper.ReadOnlyZKClient(139): Connect 0x16e895ca to 127.0.0.1:51931 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 18:01:24,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1791379d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 18:01:24,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45927] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 18:01:24,508 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36740, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 18:01:24,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45927] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x16e895ca to 127.0.0.1:51931 2023-02-16 18:01:24,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45927] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:24,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45927] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-16 18:01:24,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45927] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 18:01:24,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45927] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 18:01:24,512 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 18:01:24,513 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676571084513 2023-02-16 18:01:24,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45927] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 18:01:24,513 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-16 18:01:24,515 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 18:01:24,515 DEBUG [Listener at localhost/46409] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-16 18:01:24,515 DEBUG [Listener at localhost/46409] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-16 18:01:24,516 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 18:01:24,516 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 4 msec 2023-02-16 18:01:24,517 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 18:01:24,517 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676571084517 2023-02-16 18:01:24,534 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:24,537 INFO [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-16 18:01:24,537 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 18:01:24,538 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-16 18:01:24,538 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-16 18:01:24,539 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:24,540 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:24,541 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x1005e4b39ac0001, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 18:01:24,541 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:24,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 18:01:24,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:24,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:24,542 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:24,542 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:24,542 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40551-0x1005e4b39ac0001, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:24,542 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:24,542 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 18:01:24,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-16 18:01:24,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:24,543 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-16 18:01:24,544 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1005e4b39ac0002, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 18:01:24,544 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:24,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 18:01:24,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:24,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:24,545 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1005e4b39ac0002, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:24,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-16 18:01:24,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:24,545 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-16 18:01:24,548 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-16 18:01:24,548 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 18:01:24,556 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-16 18:01:24,556 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:24,556 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-16 18:01:24,557 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40551,1676570480716' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-16 18:01:24,557 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-16 18:01:24,557 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 18:01:24,558 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-16 18:01:24,558 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-16 18:01:24,558 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1676570480748' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-16 18:01:24,561 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:24,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:24,561 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:24,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:24,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 18:01:24,563 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:24,563 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40551-0x1005e4b39ac0001, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:24,563 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 18:01:24,563 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:24,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:24,563 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1005e4b39ac0002, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:24,563 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 18:01:24,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:24,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:24,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:24,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:24,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:24,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40551,1676570480716' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-16 18:01:24,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b5d98a6[Count = 1] remaining members to acquire global barrier 2023-02-16 18:01:24,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:24,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:24,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 18:01:24,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:24,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:24,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:24,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:24,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:24,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:24,568 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1676570480748' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-16 18:01:24,569 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b5d98a6[Count = 0] remaining members to acquire global barrier 2023-02-16 18:01:24,569 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-16 18:01:24,569 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:24,570 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1005e4b39ac0002, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:24,570 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x1005e4b39ac0001, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:24,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:24,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:24,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:24,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:24,570 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-16 18:01:24,570 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-16 18:01:24,570 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:24,571 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:24,571 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 18:01:24,573 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676570482095.d429632777f89bb78e78ce013de08e64. 2023-02-16 18:01:24,573 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676570482095.d429632777f89bb78e78ce013de08e64. started... 2023-02-16 18:01:24,574 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] regionserver.HRegion(2744): Flushing d429632777f89bb78e78ce013de08e64 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 18:01:24,574 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae. 2023-02-16 18:01:24,574 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae. started... 2023-02-16 18:01:24,574 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a. 2023-02-16 18:01:24,575 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a. started... 2023-02-16 18:01:24,575 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea. 2023-02-16 18:01:24,575 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea. started... 2023-02-16 18:01:24,576 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-16 18:01:24,578 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593. 2023-02-16 18:01:24,578 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-16 18:01:24,578 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676570482095.3eb4596533e4744167c987c3f9928464. 2023-02-16 18:01:24,578 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 18:01:24,578 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 8fdec3876078f55081787f24f961828a 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 18:01:24,578 INFO [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 31afd44b71d5642a373135dee5b626ea 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-16 18:01:24,578 INFO [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-0] regionserver.HRegion(2744): Flushing ff112adcde372b676d79e75223744fae 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 18:01:24,579 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676570482095.3eb4596533e4744167c987c3f9928464. started... 2023-02-16 18:01:24,578 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593. started... 2023-02-16 18:01:24,578 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 18:01:24,581 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 3eb4596533e4744167c987c3f9928464 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 18:01:24,588 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for f6fea7abf2b32dbe67a267c0cf01e593: 2023-02-16 18:01:24,588 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:24,588 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 18:01:24,588 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 18:01:24,588 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 18:01:24,615 DEBUG [Listener at localhost/46409] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 18:01:24,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45927] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 18:01:24,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45927] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-16 18:01:24,621 DEBUG [Listener at localhost/46409] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-16 18:01:24,660 INFO [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/ff112adcde372b676d79e75223744fae/.tmp/f1/801563733c2f41b2846d6530c3d87ad9 2023-02-16 18:01:24,670 INFO [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/31afd44b71d5642a373135dee5b626ea/.tmp/f1/f4a04c12fd7240f89fb2fbfbef900f63 2023-02-16 18:01:24,706 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/d429632777f89bb78e78ce013de08e64/.tmp/f1/e3929f2f85dc4537b631ec7078523243 2023-02-16 18:01:24,748 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593. completed. 2023-02-16 18:01:24,748 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593. 2023-02-16 18:01:24,748 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33. 2023-02-16 18:01:24,748 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-16 18:01:24,748 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33. started... 2023-02-16 18:01:24,751 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for e155df5ccc3da2f833eca9746ce9ba33: 2023-02-16 18:01:24,751 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:24,751 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 18:01:24,752 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 18:01:24,752 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/3eb4596533e4744167c987c3f9928464/.tmp/f1/341d4fc09afc45fab7fbcf2e783cf557 2023-02-16 18:01:24,752 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 18:01:24,773 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/8fdec3876078f55081787f24f961828a/.tmp/f1/8e8c6673b85b4b3f86bd4b6f1f1b22b4 2023-02-16 18:01:24,822 DEBUG [Listener at localhost/46409] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 18:01:24,823 INFO [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/ff112adcde372b676d79e75223744fae/.tmp/f2/791df0b395a24ce3bd1323aadd628fa6 2023-02-16 18:01:24,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45927] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 18:01:24,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45927] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-16 18:01:24,824 DEBUG [Listener at localhost/46409] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-16 18:01:24,831 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/ff112adcde372b676d79e75223744fae/.tmp/f1/801563733c2f41b2846d6530c3d87ad9 as hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/ff112adcde372b676d79e75223744fae/f1/801563733c2f41b2846d6530c3d87ad9 2023-02-16 18:01:24,832 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/d429632777f89bb78e78ce013de08e64/.tmp/f2/675e72cb4e724f8ba7b118ee3b6e0b59 2023-02-16 18:01:24,839 INFO [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/ff112adcde372b676d79e75223744fae/f1/801563733c2f41b2846d6530c3d87ad9, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 18:01:24,840 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/ff112adcde372b676d79e75223744fae/.tmp/f2/791df0b395a24ce3bd1323aadd628fa6 as hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/ff112adcde372b676d79e75223744fae/f2/791df0b395a24ce3bd1323aadd628fa6 2023-02-16 18:01:24,840 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33. completed. 2023-02-16 18:01:24,840 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33. 2023-02-16 18:01:24,840 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7. 2023-02-16 18:01:24,840 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-16 18:01:24,841 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7. started... 2023-02-16 18:01:24,841 INFO [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-2] regionserver.HRegion(2744): Flushing da4e4d853fcab29265a5ca41991cbfb7 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 18:01:24,846 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/d429632777f89bb78e78ce013de08e64/.tmp/f1/e3929f2f85dc4537b631ec7078523243 as hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/d429632777f89bb78e78ce013de08e64/f1/e3929f2f85dc4537b631ec7078523243 2023-02-16 18:01:24,848 INFO [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/ff112adcde372b676d79e75223744fae/f2/791df0b395a24ce3bd1323aadd628fa6, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 18:01:24,849 INFO [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for ff112adcde372b676d79e75223744fae in 271ms, sequenceid=5, compaction requested=false 2023-02-16 18:01:24,849 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-16 18:01:24,850 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for ff112adcde372b676d79e75223744fae: 2023-02-16 18:01:24,850 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:24,850 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 18:01:24,850 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/ff112adcde372b676d79e75223744fae/f1/801563733c2f41b2846d6530c3d87ad9] hfiles 2023-02-16 18:01:24,850 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/ff112adcde372b676d79e75223744fae/f1/801563733c2f41b2846d6530c3d87ad9 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:24,850 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/ff112adcde372b676d79e75223744fae/f2/791df0b395a24ce3bd1323aadd628fa6] hfiles 2023-02-16 18:01:24,850 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/ff112adcde372b676d79e75223744fae/f2/791df0b395a24ce3bd1323aadd628fa6 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:24,855 INFO [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/31afd44b71d5642a373135dee5b626ea/.tmp/f2/c42b33ed15a6458abd71bde06f429dcd 2023-02-16 18:01:24,858 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/d429632777f89bb78e78ce013de08e64/f1/e3929f2f85dc4537b631ec7078523243, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 18:01:24,859 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/d429632777f89bb78e78ce013de08e64/.tmp/f2/675e72cb4e724f8ba7b118ee3b6e0b59 as hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/d429632777f89bb78e78ce013de08e64/f2/675e72cb4e724f8ba7b118ee3b6e0b59 2023-02-16 18:01:24,866 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/31afd44b71d5642a373135dee5b626ea/.tmp/f1/f4a04c12fd7240f89fb2fbfbef900f63 as hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/31afd44b71d5642a373135dee5b626ea/f1/f4a04c12fd7240f89fb2fbfbef900f63 2023-02-16 18:01:24,877 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/d429632777f89bb78e78ce013de08e64/f2/675e72cb4e724f8ba7b118ee3b6e0b59, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 18:01:24,880 INFO [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/31afd44b71d5642a373135dee5b626ea/f1/f4a04c12fd7240f89fb2fbfbef900f63, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 18:01:24,880 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for d429632777f89bb78e78ce013de08e64 in 306ms, sequenceid=5, compaction requested=false 2023-02-16 18:01:24,881 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/31afd44b71d5642a373135dee5b626ea/.tmp/f2/c42b33ed15a6458abd71bde06f429dcd as hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/31afd44b71d5642a373135dee5b626ea/f2/c42b33ed15a6458abd71bde06f429dcd 2023-02-16 18:01:24,888 INFO [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/da4e4d853fcab29265a5ca41991cbfb7/.tmp/f1/1bd91146f26142cfad10b726e7ea7d30 2023-02-16 18:01:24,891 INFO [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/31afd44b71d5642a373135dee5b626ea/f2/c42b33ed15a6458abd71bde06f429dcd, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 18:01:24,895 INFO [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 31afd44b71d5642a373135dee5b626ea in 317ms, sequenceid=5, compaction requested=false 2023-02-16 18:01:24,897 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for d429632777f89bb78e78ce013de08e64: 2023-02-16 18:01:24,897 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 31afd44b71d5642a373135dee5b626ea: 2023-02-16 18:01:24,897 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676570482095.d429632777f89bb78e78ce013de08e64.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:24,897 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 18:01:24,897 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:24,897 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/d429632777f89bb78e78ce013de08e64/f1/e3929f2f85dc4537b631ec7078523243] hfiles 2023-02-16 18:01:24,897 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/d429632777f89bb78e78ce013de08e64/f1/e3929f2f85dc4537b631ec7078523243 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:24,897 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 18:01:24,897 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/d429632777f89bb78e78ce013de08e64/f2/675e72cb4e724f8ba7b118ee3b6e0b59] hfiles 2023-02-16 18:01:24,897 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/31afd44b71d5642a373135dee5b626ea/f1/f4a04c12fd7240f89fb2fbfbef900f63] hfiles 2023-02-16 18:01:24,897 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/d429632777f89bb78e78ce013de08e64/f2/675e72cb4e724f8ba7b118ee3b6e0b59 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:24,897 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/31afd44b71d5642a373135dee5b626ea/f1/f4a04c12fd7240f89fb2fbfbef900f63 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:24,898 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/31afd44b71d5642a373135dee5b626ea/f2/c42b33ed15a6458abd71bde06f429dcd] hfiles 2023-02-16 18:01:24,898 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/31afd44b71d5642a373135dee5b626ea/f2/c42b33ed15a6458abd71bde06f429dcd for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:24,952 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae. completed. 2023-02-16 18:01:24,952 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae. 2023-02-16 18:01:24,952 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-16 18:01:24,952 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676570482095.d429632777f89bb78e78ce013de08e64. completed. 2023-02-16 18:01:24,953 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676570482095.d429632777f89bb78e78ce013de08e64. 2023-02-16 18:01:24,953 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19. 2023-02-16 18:01:24,953 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-16 18:01:24,953 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19. started... 2023-02-16 18:01:24,953 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 19e292fb23dca311f01841f682b38f19 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-16 18:01:24,963 INFO [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/da4e4d853fcab29265a5ca41991cbfb7/.tmp/f2/6f3ae422c9394771b0047f5d8a0f93fa 2023-02-16 18:01:24,978 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/da4e4d853fcab29265a5ca41991cbfb7/.tmp/f1/1bd91146f26142cfad10b726e7ea7d30 as hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/da4e4d853fcab29265a5ca41991cbfb7/f1/1bd91146f26142cfad10b726e7ea7d30 2023-02-16 18:01:24,989 INFO [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/da4e4d853fcab29265a5ca41991cbfb7/f1/1bd91146f26142cfad10b726e7ea7d30, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 18:01:24,990 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/da4e4d853fcab29265a5ca41991cbfb7/.tmp/f2/6f3ae422c9394771b0047f5d8a0f93fa as hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/da4e4d853fcab29265a5ca41991cbfb7/f2/6f3ae422c9394771b0047f5d8a0f93fa 2023-02-16 18:01:24,996 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea. completed. 2023-02-16 18:01:24,996 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea. 2023-02-16 18:01:24,997 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-16 18:01:25,000 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/19e292fb23dca311f01841f682b38f19/.tmp/f1/c57bb23fd31b4c15b7b66ed66423e384 2023-02-16 18:01:25,003 INFO [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/da4e4d853fcab29265a5ca41991cbfb7/f2/6f3ae422c9394771b0047f5d8a0f93fa, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 18:01:25,004 INFO [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for da4e4d853fcab29265a5ca41991cbfb7 in 163ms, sequenceid=5, compaction requested=false 2023-02-16 18:01:25,004 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for da4e4d853fcab29265a5ca41991cbfb7: 2023-02-16 18:01:25,005 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,005 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 18:01:25,005 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/da4e4d853fcab29265a5ca41991cbfb7/f1/1bd91146f26142cfad10b726e7ea7d30] hfiles 2023-02-16 18:01:25,005 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/da4e4d853fcab29265a5ca41991cbfb7/f1/1bd91146f26142cfad10b726e7ea7d30 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,005 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/da4e4d853fcab29265a5ca41991cbfb7/f2/6f3ae422c9394771b0047f5d8a0f93fa] hfiles 2023-02-16 18:01:25,005 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/da4e4d853fcab29265a5ca41991cbfb7/f2/6f3ae422c9394771b0047f5d8a0f93fa for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,026 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7. completed. 2023-02-16 18:01:25,026 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7. 2023-02-16 18:01:25,026 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-16 18:01:25,026 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-16 18:01:25,026 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:25,026 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-16 18:01:25,026 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,42581,1676570480748' in zk 2023-02-16 18:01:25,027 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/19e292fb23dca311f01841f682b38f19/.tmp/f2/9ddd60fec49e420b89cdc2352093996a 2023-02-16 18:01:25,028 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:25,028 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-16 18:01:25,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:25,028 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:25,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:25,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 18:01:25,028 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-16 18:01:25,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:25,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:25,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:25,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:25,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:25,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:25,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,42581,1676570480748': 2023-02-16 18:01:25,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1676570480748' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-16 18:01:25,034 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/19e292fb23dca311f01841f682b38f19/.tmp/f1/c57bb23fd31b4c15b7b66ed66423e384 as hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/19e292fb23dca311f01841f682b38f19/f1/c57bb23fd31b4c15b7b66ed66423e384 2023-02-16 18:01:25,039 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/19e292fb23dca311f01841f682b38f19/f1/c57bb23fd31b4c15b7b66ed66423e384, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 18:01:25,040 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/19e292fb23dca311f01841f682b38f19/.tmp/f2/9ddd60fec49e420b89cdc2352093996a as hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/19e292fb23dca311f01841f682b38f19/f2/9ddd60fec49e420b89cdc2352093996a 2023-02-16 18:01:25,046 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/19e292fb23dca311f01841f682b38f19/f2/9ddd60fec49e420b89cdc2352093996a, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 18:01:25,047 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 19e292fb23dca311f01841f682b38f19 in 94ms, sequenceid=5, compaction requested=false 2023-02-16 18:01:25,047 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 19e292fb23dca311f01841f682b38f19: 2023-02-16 18:01:25,047 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,047 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 18:01:25,047 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/19e292fb23dca311f01841f682b38f19/f1/c57bb23fd31b4c15b7b66ed66423e384] hfiles 2023-02-16 18:01:25,047 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/19e292fb23dca311f01841f682b38f19/f1/c57bb23fd31b4c15b7b66ed66423e384 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,047 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/19e292fb23dca311f01841f682b38f19/f2/9ddd60fec49e420b89cdc2352093996a] hfiles 2023-02-16 18:01:25,047 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/19e292fb23dca311f01841f682b38f19/f2/9ddd60fec49e420b89cdc2352093996a for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,058 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19. completed. 2023-02-16 18:01:25,058 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19. 2023-02-16 18:01:25,058 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676570482095.eb6d74bacfba537526abbce930880639. 2023-02-16 18:01:25,058 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-16 18:01:25,058 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676570482095.eb6d74bacfba537526abbce930880639. started... 2023-02-16 18:01:25,059 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] regionserver.HRegion(2744): Flushing eb6d74bacfba537526abbce930880639 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 18:01:25,076 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/eb6d74bacfba537526abbce930880639/.tmp/f1/6c913cd5d86a4f12a25a07bc0db3c3d0 2023-02-16 18:01:25,305 DEBUG [Listener at localhost/46409] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 18:01:25,307 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/8fdec3876078f55081787f24f961828a/.tmp/f2/7bd5b25253694d24863e2c1c9e799146 2023-02-16 18:01:25,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45927] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 18:01:25,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45927] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-16 18:01:25,312 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/3eb4596533e4744167c987c3f9928464/.tmp/f2/6cb006f635694c5683e7e2aa6138a91b 2023-02-16 18:01:25,312 DEBUG [Listener at localhost/46409] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-16 18:01:25,319 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/8fdec3876078f55081787f24f961828a/.tmp/f1/8e8c6673b85b4b3f86bd4b6f1f1b22b4 as hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/8fdec3876078f55081787f24f961828a/f1/8e8c6673b85b4b3f86bd4b6f1f1b22b4 2023-02-16 18:01:25,324 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/3eb4596533e4744167c987c3f9928464/.tmp/f1/341d4fc09afc45fab7fbcf2e783cf557 as hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/3eb4596533e4744167c987c3f9928464/f1/341d4fc09afc45fab7fbcf2e783cf557 2023-02-16 18:01:25,326 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/8fdec3876078f55081787f24f961828a/f1/8e8c6673b85b4b3f86bd4b6f1f1b22b4, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 18:01:25,328 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/8fdec3876078f55081787f24f961828a/.tmp/f2/7bd5b25253694d24863e2c1c9e799146 as hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/8fdec3876078f55081787f24f961828a/f2/7bd5b25253694d24863e2c1c9e799146 2023-02-16 18:01:25,330 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/3eb4596533e4744167c987c3f9928464/f1/341d4fc09afc45fab7fbcf2e783cf557, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 18:01:25,331 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/3eb4596533e4744167c987c3f9928464/.tmp/f2/6cb006f635694c5683e7e2aa6138a91b as hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/3eb4596533e4744167c987c3f9928464/f2/6cb006f635694c5683e7e2aa6138a91b 2023-02-16 18:01:25,334 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/8fdec3876078f55081787f24f961828a/f2/7bd5b25253694d24863e2c1c9e799146, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 18:01:25,336 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 8fdec3876078f55081787f24f961828a in 758ms, sequenceid=5, compaction requested=false 2023-02-16 18:01:25,336 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 8fdec3876078f55081787f24f961828a: 2023-02-16 18:01:25,336 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/eb6d74bacfba537526abbce930880639/.tmp/f2/d3aa4d87925e494c881d5479ae7d79c1 2023-02-16 18:01:25,336 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,337 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 18:01:25,337 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/8fdec3876078f55081787f24f961828a/f1/8e8c6673b85b4b3f86bd4b6f1f1b22b4] hfiles 2023-02-16 18:01:25,337 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/8fdec3876078f55081787f24f961828a/f1/8e8c6673b85b4b3f86bd4b6f1f1b22b4 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,337 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/8fdec3876078f55081787f24f961828a/f2/7bd5b25253694d24863e2c1c9e799146] hfiles 2023-02-16 18:01:25,337 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/8fdec3876078f55081787f24f961828a/f2/7bd5b25253694d24863e2c1c9e799146 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,340 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/3eb4596533e4744167c987c3f9928464/f2/6cb006f635694c5683e7e2aa6138a91b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 18:01:25,340 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 3eb4596533e4744167c987c3f9928464 in 759ms, sequenceid=5, compaction requested=false 2023-02-16 18:01:25,341 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 3eb4596533e4744167c987c3f9928464: 2023-02-16 18:01:25,341 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676570482095.3eb4596533e4744167c987c3f9928464.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,341 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 18:01:25,341 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/3eb4596533e4744167c987c3f9928464/f1/341d4fc09afc45fab7fbcf2e783cf557] hfiles 2023-02-16 18:01:25,341 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/3eb4596533e4744167c987c3f9928464/f1/341d4fc09afc45fab7fbcf2e783cf557 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,341 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/3eb4596533e4744167c987c3f9928464/f2/6cb006f635694c5683e7e2aa6138a91b] hfiles 2023-02-16 18:01:25,341 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/3eb4596533e4744167c987c3f9928464/f2/6cb006f635694c5683e7e2aa6138a91b for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,342 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/eb6d74bacfba537526abbce930880639/.tmp/f1/6c913cd5d86a4f12a25a07bc0db3c3d0 as hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/eb6d74bacfba537526abbce930880639/f1/6c913cd5d86a4f12a25a07bc0db3c3d0 2023-02-16 18:01:25,346 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/eb6d74bacfba537526abbce930880639/f1/6c913cd5d86a4f12a25a07bc0db3c3d0, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 18:01:25,347 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/eb6d74bacfba537526abbce930880639/.tmp/f2/d3aa4d87925e494c881d5479ae7d79c1 as hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/eb6d74bacfba537526abbce930880639/f2/d3aa4d87925e494c881d5479ae7d79c1 2023-02-16 18:01:25,351 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/eb6d74bacfba537526abbce930880639/f2/d3aa4d87925e494c881d5479ae7d79c1, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 18:01:25,352 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a. completed. 2023-02-16 18:01:25,352 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a. 2023-02-16 18:01:25,352 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-16 18:01:25,352 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for eb6d74bacfba537526abbce930880639 in 293ms, sequenceid=5, compaction requested=false 2023-02-16 18:01:25,353 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for eb6d74bacfba537526abbce930880639: 2023-02-16 18:01:25,353 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676570482095.eb6d74bacfba537526abbce930880639.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,353 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 18:01:25,353 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/eb6d74bacfba537526abbce930880639/f1/6c913cd5d86a4f12a25a07bc0db3c3d0] hfiles 2023-02-16 18:01:25,353 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/eb6d74bacfba537526abbce930880639/f1/6c913cd5d86a4f12a25a07bc0db3c3d0 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,353 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/eb6d74bacfba537526abbce930880639/f2/d3aa4d87925e494c881d5479ae7d79c1] hfiles 2023-02-16 18:01:25,353 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/eb6d74bacfba537526abbce930880639/f2/d3aa4d87925e494c881d5479ae7d79c1 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,356 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676570482095.3eb4596533e4744167c987c3f9928464. completed. 2023-02-16 18:01:25,356 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676570482095.3eb4596533e4744167c987c3f9928464. 2023-02-16 18:01:25,356 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-16 18:01:25,359 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676570482095.eb6d74bacfba537526abbce930880639. completed. 2023-02-16 18:01:25,359 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676570482095.eb6d74bacfba537526abbce930880639. 2023-02-16 18:01:25,359 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-16 18:01:25,359 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-16 18:01:25,359 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:25,360 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-16 18:01:25,360 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,40551,1676570480716' in zk 2023-02-16 18:01:25,362 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:25,362 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-16 18:01:25,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:25,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:25,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 18:01:25,362 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:25,362 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-16 18:01:25,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:25,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:25,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:25,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:25,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:25,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:25,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:25,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,40551,1676570480716': 2023-02-16 18:01:25,366 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40551,1676570480716' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-16 18:01:25,366 INFO [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-16 18:01:25,366 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 18:01:25,366 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 18:01:25,366 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,366 INFO [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-16 18:01:25,368 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x1005e4b39ac0001, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,368 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1005e4b39ac0002, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,368 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1005e4b39ac0002, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 18:01:25,368 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x1005e4b39ac0001, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 18:01:25,368 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:25,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 18:01:25,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 18:01:25,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:25,369 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:25,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 18:01:25,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:25,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:25,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,369 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:25,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:25,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:25,370 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:25,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:25,371 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:25,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:25,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:25,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:25,376 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1005e4b39ac0002, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 18:01:25,376 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x1005e4b39ac0001, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 18:01:25,376 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1005e4b39ac0002, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 18:01:25,376 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x1005e4b39ac0001, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 18:01:25,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 18:01:25,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:25,376 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,376 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:25,376 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,376 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,376 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:25,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 18:01:25,376 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:25,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:25,377 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 18:01:25,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:25,377 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:25,377 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,377 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:25,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 18:01:25,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:25,377 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,378 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,407 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,429 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-16 18:01:25,429 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,429 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:25,429 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676570484513Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676570485376 (+863 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1676570485376Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1676570485385 (+9 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676570485394 (+9 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1676570485429 (+35 ms) 2023-02-16 18:01:25,431 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 18:01:25,432 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 917 msec 2023-02-16 18:01:25,812 DEBUG [Listener at localhost/46409] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 18:01:25,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45927] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 18:01:25,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45927] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-16 18:01:25,814 INFO [Listener at localhost/46409] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-16 18:01:25,820 INFO [Listener at localhost/46409] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-16 18:01:25,829 INFO [Listener at localhost/46409] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-16 18:01:25,868 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6760 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae. 2023-02-16 18:01:25,878 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40551] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 10816 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19. 2023-02-16 18:01:25,959 INFO [Listener at localhost/46409] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-16 18:01:25,965 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45927] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-16 18:01:25,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45927] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-16 18:01:25,968 INFO [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-16 18:01:25,968 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 18:01:25,969 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-16 18:01:25,969 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-16 18:01:25,969 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:25,969 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 18:01:25,971 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1005e4b39ac0002, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 18:01:25,971 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:25,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 18:01:25,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:25,972 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x1005e4b39ac0001, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 18:01:25,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 18:01:25,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:25,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 18:01:25,972 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:25,972 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:25,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 18:01:25,973 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1005e4b39ac0002, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:25,973 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:25,973 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 18:01:25,973 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40551-0x1005e4b39ac0001, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:25,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 18:01:25,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 18:01:25,973 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-16 18:01:25,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 18:01:25,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 18:01:25,973 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-16 18:01:25,973 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-16 18:01:25,973 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-16 18:01:25,973 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-16 18:01:25,974 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 18:01:25,974 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-16 18:01:25,974 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-16 18:01:25,974 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 18:01:25,975 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-16 18:01:25,975 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae. 2023-02-16 18:01:25,975 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae. started... 2023-02-16 18:01:25,975 INFO [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ff112adcde372b676d79e75223744fae 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 18:01:25,976 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea. 2023-02-16 18:01:25,976 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea. started... 2023-02-16 18:01:25,976 INFO [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 31afd44b71d5642a373135dee5b626ea 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-16 18:01:25,979 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676570482095.d429632777f89bb78e78ce013de08e64. 2023-02-16 18:01:25,980 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676570482095.3eb4596533e4744167c987c3f9928464. 2023-02-16 18:01:25,979 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-16 18:01:25,980 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 18:01:25,979 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a. 2023-02-16 18:01:25,979 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-16 18:01:25,981 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 18:01:25,980 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676570482095.3eb4596533e4744167c987c3f9928464. started... 2023-02-16 18:01:25,980 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676570482095.d429632777f89bb78e78ce013de08e64. started... 2023-02-16 18:01:25,980 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593. 2023-02-16 18:01:25,981 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 3eb4596533e4744167c987c3f9928464 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 18:01:25,981 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a. started... 2023-02-16 18:01:25,981 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593. started... 2023-02-16 18:01:25,981 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 8fdec3876078f55081787f24f961828a 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 18:01:25,981 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for f6fea7abf2b32dbe67a267c0cf01e593: 2023-02-16 18:01:25,981 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d429632777f89bb78e78ce013de08e64 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 18:01:25,984 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593. 2023-02-16 18:01:25,984 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33. 2023-02-16 18:01:25,984 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-16 18:01:25,984 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33. started... 2023-02-16 18:01:25,984 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for e155df5ccc3da2f833eca9746ce9ba33: 2023-02-16 18:01:25,984 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33. 2023-02-16 18:01:25,984 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7. 2023-02-16 18:01:25,984 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7. started... 2023-02-16 18:01:25,984 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-16 18:01:25,984 INFO [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing da4e4d853fcab29265a5ca41991cbfb7 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 18:01:26,024 INFO [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/da4e4d853fcab29265a5ca41991cbfb7/.tmp/f1/a5b7ca285f3141428dd1bb2f5019f861 2023-02-16 18:01:26,028 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/8fdec3876078f55081787f24f961828a/.tmp/f1/0fcd66260bdd4da088c552253f12f125 2023-02-16 18:01:26,035 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/d429632777f89bb78e78ce013de08e64/.tmp/f1/83770cb43dee446cb1a085ea718a0471 2023-02-16 18:01:26,040 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/3eb4596533e4744167c987c3f9928464/.tmp/f1/0336b33f766e40e2bf6f86997904ae63 2023-02-16 18:01:26,061 INFO [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/da4e4d853fcab29265a5ca41991cbfb7/.tmp/f2/6692bca1bebc404791afdc9f5f1693b8 2023-02-16 18:01:26,068 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/da4e4d853fcab29265a5ca41991cbfb7/.tmp/f1/a5b7ca285f3141428dd1bb2f5019f861 as hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/da4e4d853fcab29265a5ca41991cbfb7/f1/a5b7ca285f3141428dd1bb2f5019f861 2023-02-16 18:01:26,077 INFO [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/da4e4d853fcab29265a5ca41991cbfb7/f1/a5b7ca285f3141428dd1bb2f5019f861, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 18:01:26,078 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/da4e4d853fcab29265a5ca41991cbfb7/.tmp/f2/6692bca1bebc404791afdc9f5f1693b8 as hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/da4e4d853fcab29265a5ca41991cbfb7/f2/6692bca1bebc404791afdc9f5f1693b8 2023-02-16 18:01:26,082 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/8fdec3876078f55081787f24f961828a/.tmp/f2/00fdce17788d44449a81fdb037b1a5f5 2023-02-16 18:01:26,085 INFO [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/da4e4d853fcab29265a5ca41991cbfb7/f2/6692bca1bebc404791afdc9f5f1693b8, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 18:01:26,086 INFO [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for da4e4d853fcab29265a5ca41991cbfb7 in 102ms, sequenceid=9, compaction requested=false 2023-02-16 18:01:26,086 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for da4e4d853fcab29265a5ca41991cbfb7: 2023-02-16 18:01:26,086 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7. 2023-02-16 18:01:26,086 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-16 18:01:26,089 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/8fdec3876078f55081787f24f961828a/.tmp/f1/0fcd66260bdd4da088c552253f12f125 as hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/8fdec3876078f55081787f24f961828a/f1/0fcd66260bdd4da088c552253f12f125 2023-02-16 18:01:26,096 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/8fdec3876078f55081787f24f961828a/f1/0fcd66260bdd4da088c552253f12f125, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 18:01:26,097 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/8fdec3876078f55081787f24f961828a/.tmp/f2/00fdce17788d44449a81fdb037b1a5f5 as hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/8fdec3876078f55081787f24f961828a/f2/00fdce17788d44449a81fdb037b1a5f5 2023-02-16 18:01:26,102 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/d429632777f89bb78e78ce013de08e64/.tmp/f2/43e24e6ed9da4983ac4bbe7bae31fbb7 2023-02-16 18:01:26,108 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/3eb4596533e4744167c987c3f9928464/.tmp/f2/ffb0e2a65408424f850687e0230d5ad3 2023-02-16 18:01:26,110 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/d429632777f89bb78e78ce013de08e64/.tmp/f1/83770cb43dee446cb1a085ea718a0471 as hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/d429632777f89bb78e78ce013de08e64/f1/83770cb43dee446cb1a085ea718a0471 2023-02-16 18:01:26,112 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/8fdec3876078f55081787f24f961828a/f2/00fdce17788d44449a81fdb037b1a5f5, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 18:01:26,113 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 8fdec3876078f55081787f24f961828a in 132ms, sequenceid=9, compaction requested=false 2023-02-16 18:01:26,113 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 8fdec3876078f55081787f24f961828a: 2023-02-16 18:01:26,113 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a. 2023-02-16 18:01:26,113 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19. 2023-02-16 18:01:26,113 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-16 18:01:26,113 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19. started... 2023-02-16 18:01:26,114 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 19e292fb23dca311f01841f682b38f19 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-16 18:01:26,122 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/3eb4596533e4744167c987c3f9928464/.tmp/f1/0336b33f766e40e2bf6f86997904ae63 as hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/3eb4596533e4744167c987c3f9928464/f1/0336b33f766e40e2bf6f86997904ae63 2023-02-16 18:01:26,122 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/d429632777f89bb78e78ce013de08e64/f1/83770cb43dee446cb1a085ea718a0471, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 18:01:26,123 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/d429632777f89bb78e78ce013de08e64/.tmp/f2/43e24e6ed9da4983ac4bbe7bae31fbb7 as hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/d429632777f89bb78e78ce013de08e64/f2/43e24e6ed9da4983ac4bbe7bae31fbb7 2023-02-16 18:01:26,131 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/3eb4596533e4744167c987c3f9928464/f1/0336b33f766e40e2bf6f86997904ae63, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 18:01:26,133 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/3eb4596533e4744167c987c3f9928464/.tmp/f2/ffb0e2a65408424f850687e0230d5ad3 as hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/3eb4596533e4744167c987c3f9928464/f2/ffb0e2a65408424f850687e0230d5ad3 2023-02-16 18:01:26,134 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/d429632777f89bb78e78ce013de08e64/f2/43e24e6ed9da4983ac4bbe7bae31fbb7, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 18:01:26,135 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for d429632777f89bb78e78ce013de08e64 in 154ms, sequenceid=9, compaction requested=false 2023-02-16 18:01:26,135 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d429632777f89bb78e78ce013de08e64: 2023-02-16 18:01:26,135 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676570482095.d429632777f89bb78e78ce013de08e64. 2023-02-16 18:01:26,135 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676570482095.eb6d74bacfba537526abbce930880639. 2023-02-16 18:01:26,135 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676570482095.eb6d74bacfba537526abbce930880639. started... 2023-02-16 18:01:26,135 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-16 18:01:26,135 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing eb6d74bacfba537526abbce930880639 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 18:01:26,146 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/3eb4596533e4744167c987c3f9928464/f2/ffb0e2a65408424f850687e0230d5ad3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 18:01:26,147 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 3eb4596533e4744167c987c3f9928464 in 166ms, sequenceid=9, compaction requested=false 2023-02-16 18:01:26,148 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 3eb4596533e4744167c987c3f9928464: 2023-02-16 18:01:26,148 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676570482095.3eb4596533e4744167c987c3f9928464. 2023-02-16 18:01:26,148 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-16 18:01:26,156 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/19e292fb23dca311f01841f682b38f19/.tmp/f1/86db555c8a064cd59e163720227637b1 2023-02-16 18:01:26,172 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/eb6d74bacfba537526abbce930880639/.tmp/f1/f1c34c8155ae486f96789e8ec1f62945 2023-02-16 18:01:26,184 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/19e292fb23dca311f01841f682b38f19/.tmp/f2/e306fcd4518c4fdd828a0abf8d3fbf2a 2023-02-16 18:01:26,189 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/19e292fb23dca311f01841f682b38f19/.tmp/f1/86db555c8a064cd59e163720227637b1 as hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/19e292fb23dca311f01841f682b38f19/f1/86db555c8a064cd59e163720227637b1 2023-02-16 18:01:26,191 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/eb6d74bacfba537526abbce930880639/.tmp/f2/f8d9162a46e949d6b07b0cf827bf7b9e 2023-02-16 18:01:26,195 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/19e292fb23dca311f01841f682b38f19/f1/86db555c8a064cd59e163720227637b1, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 18:01:26,196 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/19e292fb23dca311f01841f682b38f19/.tmp/f2/e306fcd4518c4fdd828a0abf8d3fbf2a as hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/19e292fb23dca311f01841f682b38f19/f2/e306fcd4518c4fdd828a0abf8d3fbf2a 2023-02-16 18:01:26,198 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/eb6d74bacfba537526abbce930880639/.tmp/f1/f1c34c8155ae486f96789e8ec1f62945 as hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/eb6d74bacfba537526abbce930880639/f1/f1c34c8155ae486f96789e8ec1f62945 2023-02-16 18:01:26,203 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/19e292fb23dca311f01841f682b38f19/f2/e306fcd4518c4fdd828a0abf8d3fbf2a, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 18:01:26,204 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 19e292fb23dca311f01841f682b38f19 in 90ms, sequenceid=9, compaction requested=false 2023-02-16 18:01:26,204 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 19e292fb23dca311f01841f682b38f19: 2023-02-16 18:01:26,204 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19. 2023-02-16 18:01:26,204 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-16 18:01:26,206 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/eb6d74bacfba537526abbce930880639/f1/f1c34c8155ae486f96789e8ec1f62945, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 18:01:26,207 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/eb6d74bacfba537526abbce930880639/.tmp/f2/f8d9162a46e949d6b07b0cf827bf7b9e as hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/eb6d74bacfba537526abbce930880639/f2/f8d9162a46e949d6b07b0cf827bf7b9e 2023-02-16 18:01:26,218 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/eb6d74bacfba537526abbce930880639/f2/f8d9162a46e949d6b07b0cf827bf7b9e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 18:01:26,218 INFO [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for eb6d74bacfba537526abbce930880639 in 83ms, sequenceid=9, compaction requested=false 2023-02-16 18:01:26,219 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for eb6d74bacfba537526abbce930880639: 2023-02-16 18:01:26,219 DEBUG [rs(jenkins-hbase4.apache.org,40551,1676570480716)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676570482095.eb6d74bacfba537526abbce930880639. 2023-02-16 18:01:26,219 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-16 18:01:26,219 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-16 18:01:26,219 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:26,219 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-16 18:01:26,219 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40551,1676570480716' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-16 18:01:26,222 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 18:01:26,222 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:26,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:26,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:26,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 18:01:26,222 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40551-0x1005e4b39ac0001, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 18:01:26,222 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 18:01:26,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:26,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:26,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 18:01:26,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:26,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:26,224 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40551,1676570480716' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-16 18:01:26,224 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1f620f15[Count = 1] remaining members to acquire global barrier 2023-02-16 18:01:26,418 INFO [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/31afd44b71d5642a373135dee5b626ea/.tmp/f1/5a76907faa4f4ad8bd60e7351ef46176 2023-02-16 18:01:26,418 INFO [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/ff112adcde372b676d79e75223744fae/.tmp/f1/f899706a5b8440018e2a2e4e153faab3 2023-02-16 18:01:26,443 INFO [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/31afd44b71d5642a373135dee5b626ea/.tmp/f2/61b4452722bd4219af8dad9874570cb2 2023-02-16 18:01:26,447 INFO [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/ff112adcde372b676d79e75223744fae/.tmp/f2/73588d6bc25c4272acb312570c25a2ec 2023-02-16 18:01:26,449 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/31afd44b71d5642a373135dee5b626ea/.tmp/f1/5a76907faa4f4ad8bd60e7351ef46176 as hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/31afd44b71d5642a373135dee5b626ea/f1/5a76907faa4f4ad8bd60e7351ef46176 2023-02-16 18:01:26,452 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/ff112adcde372b676d79e75223744fae/.tmp/f1/f899706a5b8440018e2a2e4e153faab3 as hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/ff112adcde372b676d79e75223744fae/f1/f899706a5b8440018e2a2e4e153faab3 2023-02-16 18:01:26,455 INFO [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/31afd44b71d5642a373135dee5b626ea/f1/5a76907faa4f4ad8bd60e7351ef46176, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 18:01:26,456 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/31afd44b71d5642a373135dee5b626ea/.tmp/f2/61b4452722bd4219af8dad9874570cb2 as hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/31afd44b71d5642a373135dee5b626ea/f2/61b4452722bd4219af8dad9874570cb2 2023-02-16 18:01:26,458 INFO [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/ff112adcde372b676d79e75223744fae/f1/f899706a5b8440018e2a2e4e153faab3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 18:01:26,459 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/ff112adcde372b676d79e75223744fae/.tmp/f2/73588d6bc25c4272acb312570c25a2ec as hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/ff112adcde372b676d79e75223744fae/f2/73588d6bc25c4272acb312570c25a2ec 2023-02-16 18:01:26,461 INFO [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/31afd44b71d5642a373135dee5b626ea/f2/61b4452722bd4219af8dad9874570cb2, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 18:01:26,462 INFO [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 31afd44b71d5642a373135dee5b626ea in 486ms, sequenceid=9, compaction requested=false 2023-02-16 18:01:26,462 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 31afd44b71d5642a373135dee5b626ea: 2023-02-16 18:01:26,462 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea. 2023-02-16 18:01:26,462 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-16 18:01:26,472 INFO [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/ff112adcde372b676d79e75223744fae/f2/73588d6bc25c4272acb312570c25a2ec, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 18:01:26,473 INFO [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for ff112adcde372b676d79e75223744fae in 498ms, sequenceid=9, compaction requested=false 2023-02-16 18:01:26,473 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ff112adcde372b676d79e75223744fae: 2023-02-16 18:01:26,473 DEBUG [rs(jenkins-hbase4.apache.org,42581,1676570480748)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae. 2023-02-16 18:01:26,473 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-16 18:01:26,473 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-16 18:01:26,473 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:26,473 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-16 18:01:26,473 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1676570480748' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-16 18:01:26,475 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 18:01:26,475 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:26,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:26,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:26,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 18:01:26,475 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1005e4b39ac0002, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 18:01:26,475 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 18:01:26,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:26,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:26,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 18:01:26,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:26,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:26,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:26,477 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1676570480748' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-16 18:01:26,477 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1f620f15[Count = 0] remaining members to acquire global barrier 2023-02-16 18:01:26,477 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-16 18:01:26,477 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 18:01:26,478 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1005e4b39ac0002, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 18:01:26,478 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x1005e4b39ac0001, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 18:01:26,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 18:01:26,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 18:01:26,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 18:01:26,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 18:01:26,479 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-16 18:01:26,479 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-16 18:01:26,479 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-16 18:01:26,479 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:26,479 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-16 18:01:26,479 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,42581,1676570480748' in zk 2023-02-16 18:01:26,479 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,40551,1676570480716' in zk 2023-02-16 18:01:26,479 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:26,479 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 18:01:26,481 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:26,481 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-16 18:01:26,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:26,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:26,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 18:01:26,481 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:26,481 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1676570480716' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-16 18:01:26,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:26,483 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-16 18:01:26,483 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:26,483 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:26,483 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1676570480748' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-16 18:01:26,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:26,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 18:01:26,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:26,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:26,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:26,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 18:01:26,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:26,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:26,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,40551,1676570480716': 2023-02-16 18:01:26,487 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40551,1676570480716' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-16 18:01:26,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:26,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:26,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 18:01:26,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:26,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:26,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 18:01:26,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:26,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:26,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:26,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 18:01:26,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:26,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:26,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,42581,1676570480748': 2023-02-16 18:01:26,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1676570480748' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-16 18:01:26,489 INFO [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-16 18:01:26,489 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 18:01:26,489 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 18:01:26,489 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-16 18:01:26,490 INFO [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-16 18:01:26,491 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x1005e4b39ac0001, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:26,491 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:26,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:26,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:26,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:26,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 18:01:26,491 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x1005e4b39ac0001, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 18:01:26,491 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1005e4b39ac0002, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:26,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:26,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:26,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:26,491 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1005e4b39ac0002, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 18:01:26,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:26,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 18:01:26,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:26,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 18:01:26,492 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:26,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:26,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 18:01:26,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:26,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:26,492 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:26,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:26,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 18:01:26,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:26,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:26,495 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:26,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:26,495 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:26,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 18:01:26,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:26,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:26,498 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:26,498 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1005e4b39ac0002, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 18:01:26,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 18:01:26,498 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 18:01:26,498 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x1005e4b39ac0001, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 18:01:26,498 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1005e4b39ac0002, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 18:01:26,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 18:01:26,498 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-16 18:01:26,498 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-16 18:01:26,498 DEBUG [(jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:26,498 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x1005e4b39ac0001, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 18:01:26,498 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:26,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:26,500 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 18:01:26,500 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:26,500 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 18:01:26,500 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:26,500 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 18:01:26,500 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:26,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:26,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 18:01:26,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:26,500 DEBUG [Listener at localhost/46409] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-16 18:01:26,501 DEBUG [Listener at localhost/46409] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-16 18:01:26,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 18:01:26,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:26,601 DEBUG [Listener at localhost/46409] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-16 18:01:26,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45927] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-16 18:01:26,603 INFO [Listener at localhost/46409] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-16 18:01:26,603 DEBUG [Listener at localhost/46409] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7216b6f3 to 127.0.0.1:51931 2023-02-16 18:01:26,603 DEBUG [Listener at localhost/46409] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:26,603 DEBUG [Listener at localhost/46409] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-16 18:01:26,604 DEBUG [Listener at localhost/46409] util.JVMClusterUtil(257): Found active master hash=421778718, stopped=false 2023-02-16 18:01:26,604 INFO [Listener at localhost/46409] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,45927,1676570480648 2023-02-16 18:01:26,607 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:26,607 INFO [Listener at localhost/46409] procedure2.ProcedureExecutor(629): Stopping 2023-02-16 18:01:26,607 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1005e4b39ac0002, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:26,607 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x1005e4b39ac0001, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:26,607 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:26,610 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:26,610 DEBUG [Listener at localhost/46409] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x101aacad to 127.0.0.1:51931 2023-02-16 18:01:26,610 DEBUG [Listener at localhost/46409] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:26,610 INFO [Listener at localhost/46409] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40551,1676570480716' ***** 2023-02-16 18:01:26,610 INFO [Listener at localhost/46409] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 18:01:26,610 INFO [Listener at localhost/46409] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42581,1676570480748' ***** 2023-02-16 18:01:26,610 INFO [Listener at localhost/46409] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 18:01:26,610 INFO [RS:0;jenkins-hbase4:40551] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 18:01:26,610 INFO [RS:1;jenkins-hbase4:42581] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 18:01:26,610 INFO [RS:0;jenkins-hbase4:40551] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 18:01:26,611 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 18:01:26,610 INFO [RS:1;jenkins-hbase4:42581] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 18:01:26,611 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 18:01:26,611 INFO [RS:1;jenkins-hbase4:42581] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 18:01:26,611 INFO [RS:1;jenkins-hbase4:42581] regionserver.HRegionServer(3304): Received CLOSE for ff112adcde372b676d79e75223744fae 2023-02-16 18:01:26,611 INFO [RS:0;jenkins-hbase4:40551] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 18:01:26,612 INFO [RS:1;jenkins-hbase4:42581] regionserver.HRegionServer(3304): Received CLOSE for 31afd44b71d5642a373135dee5b626ea 2023-02-16 18:01:26,612 INFO [RS:1;jenkins-hbase4:42581] regionserver.HRegionServer(3304): Received CLOSE for f6fea7abf2b32dbe67a267c0cf01e593 2023-02-16 18:01:26,612 INFO [RS:1;jenkins-hbase4:42581] regionserver.HRegionServer(3304): Received CLOSE for e155df5ccc3da2f833eca9746ce9ba33 2023-02-16 18:01:26,612 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1005e4b39ac0002, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:26,612 INFO [RS:0;jenkins-hbase4:40551] regionserver.HRegionServer(3304): Received CLOSE for d429632777f89bb78e78ce013de08e64 2023-02-16 18:01:26,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ff112adcde372b676d79e75223744fae, disabling compactions & flushes 2023-02-16 18:01:26,613 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae. 2023-02-16 18:01:26,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae. 2023-02-16 18:01:26,613 INFO [RS:0;jenkins-hbase4:40551] regionserver.HRegionServer(3304): Received CLOSE for 8222039b4a86ba55c0bc50e2086dd442 2023-02-16 18:01:26,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae. after waiting 0 ms 2023-02-16 18:01:26,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d429632777f89bb78e78ce013de08e64, disabling compactions & flushes 2023-02-16 18:01:26,613 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676570482095.d429632777f89bb78e78ce013de08e64. 2023-02-16 18:01:26,613 INFO [RS:1;jenkins-hbase4:42581] regionserver.HRegionServer(3304): Received CLOSE for da4e4d853fcab29265a5ca41991cbfb7 2023-02-16 18:01:26,613 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40551-0x1005e4b39ac0001, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:26,613 INFO [RS:1;jenkins-hbase4:42581] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:26,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae. 2023-02-16 18:01:26,613 INFO [RS:0;jenkins-hbase4:40551] regionserver.HRegionServer(3304): Received CLOSE for 8fdec3876078f55081787f24f961828a 2023-02-16 18:01:26,613 DEBUG [RS:1;jenkins-hbase4:42581] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x01792ddb to 127.0.0.1:51931 2023-02-16 18:01:26,614 DEBUG [RS:1;jenkins-hbase4:42581] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:26,614 INFO [RS:1;jenkins-hbase4:42581] regionserver.HRegionServer(1475): Waiting on 5 regions to close 2023-02-16 18:01:26,614 DEBUG [RS:1;jenkins-hbase4:42581] regionserver.HRegionServer(1479): Online Regions={ff112adcde372b676d79e75223744fae=testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae., 31afd44b71d5642a373135dee5b626ea=testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea., f6fea7abf2b32dbe67a267c0cf01e593=testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593., e155df5ccc3da2f833eca9746ce9ba33=testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33., da4e4d853fcab29265a5ca41991cbfb7=testWithMapReduce,m\xED\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7.} 2023-02-16 18:01:26,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676570482095.d429632777f89bb78e78ce013de08e64. 2023-02-16 18:01:26,614 DEBUG [RS:1;jenkins-hbase4:42581] regionserver.HRegionServer(1505): Waiting on 31afd44b71d5642a373135dee5b626ea, da4e4d853fcab29265a5ca41991cbfb7, e155df5ccc3da2f833eca9746ce9ba33, f6fea7abf2b32dbe67a267c0cf01e593, ff112adcde372b676d79e75223744fae 2023-02-16 18:01:26,614 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676570482095.d429632777f89bb78e78ce013de08e64. after waiting 0 ms 2023-02-16 18:01:26,614 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676570482095.d429632777f89bb78e78ce013de08e64. 2023-02-16 18:01:26,613 INFO [RS:0;jenkins-hbase4:40551] regionserver.HRegionServer(3304): Received CLOSE for 3eb4596533e4744167c987c3f9928464 2023-02-16 18:01:26,614 INFO [RS:0;jenkins-hbase4:40551] regionserver.HRegionServer(3304): Received CLOSE for 19e292fb23dca311f01841f682b38f19 2023-02-16 18:01:26,614 INFO [RS:0;jenkins-hbase4:40551] regionserver.HRegionServer(3304): Received CLOSE for eb6d74bacfba537526abbce930880639 2023-02-16 18:01:26,614 INFO [RS:0;jenkins-hbase4:40551] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:26,614 DEBUG [RS:0;jenkins-hbase4:40551] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1d8c2568 to 127.0.0.1:51931 2023-02-16 18:01:26,614 DEBUG [RS:0;jenkins-hbase4:40551] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:26,614 INFO [RS:0;jenkins-hbase4:40551] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 18:01:26,614 INFO [RS:0;jenkins-hbase4:40551] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 18:01:26,614 INFO [RS:0;jenkins-hbase4:40551] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 18:01:26,614 INFO [RS:0;jenkins-hbase4:40551] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-16 18:01:26,615 INFO [RS:0;jenkins-hbase4:40551] regionserver.HRegionServer(1475): Waiting on 7 regions to close 2023-02-16 18:01:26,615 DEBUG [RS:0;jenkins-hbase4:40551] regionserver.HRegionServer(1479): Online Regions={d429632777f89bb78e78ce013de08e64=testWithMapReduce,q\x11\x10,1676570482095.d429632777f89bb78e78ce013de08e64., 8222039b4a86ba55c0bc50e2086dd442=hbase:namespace,,1676570481452.8222039b4a86ba55c0bc50e2086dd442., 8fdec3876078f55081787f24f961828a=testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a., 3eb4596533e4744167c987c3f9928464=testWithMapReduce,d\x84\x84,1676570482095.3eb4596533e4744167c987c3f9928464., 1588230740=hbase:meta,,1.1588230740, 19e292fb23dca311f01841f682b38f19=testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19., eb6d74bacfba537526abbce930880639=testWithMapReduce,g\xA7\xA7,1676570482095.eb6d74bacfba537526abbce930880639.} 2023-02-16 18:01:26,615 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 18:01:26,615 DEBUG [RS:0;jenkins-hbase4:40551] regionserver.HRegionServer(1505): Waiting on 1588230740, 19e292fb23dca311f01841f682b38f19, 3eb4596533e4744167c987c3f9928464, 8222039b4a86ba55c0bc50e2086dd442, 8fdec3876078f55081787f24f961828a, d429632777f89bb78e78ce013de08e64, eb6d74bacfba537526abbce930880639 2023-02-16 18:01:26,616 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 18:01:26,618 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 18:01:26,619 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 18:01:26,619 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 18:01:26,620 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.95 KB heapSize=23.05 KB 2023-02-16 18:01:26,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/d429632777f89bb78e78ce013de08e64/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 18:01:26,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/ff112adcde372b676d79e75223744fae/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 18:01:26,633 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae. 2023-02-16 18:01:26,633 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676570482095.d429632777f89bb78e78ce013de08e64. 2023-02-16 18:01:26,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ff112adcde372b676d79e75223744fae: 2023-02-16 18:01:26,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d429632777f89bb78e78ce013de08e64: 2023-02-16 18:01:26,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae. 2023-02-16 18:01:26,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1676570482095.d429632777f89bb78e78ce013de08e64. 2023-02-16 18:01:26,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 31afd44b71d5642a373135dee5b626ea, disabling compactions & flushes 2023-02-16 18:01:26,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8222039b4a86ba55c0bc50e2086dd442, disabling compactions & flushes 2023-02-16 18:01:26,633 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea. 2023-02-16 18:01:26,633 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676570481452.8222039b4a86ba55c0bc50e2086dd442. 2023-02-16 18:01:26,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676570481452.8222039b4a86ba55c0bc50e2086dd442. 2023-02-16 18:01:26,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea. 2023-02-16 18:01:26,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676570481452.8222039b4a86ba55c0bc50e2086dd442. after waiting 0 ms 2023-02-16 18:01:26,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676570481452.8222039b4a86ba55c0bc50e2086dd442. 2023-02-16 18:01:26,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea. after waiting 0 ms 2023-02-16 18:01:26,634 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 8222039b4a86ba55c0bc50e2086dd442 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-16 18:01:26,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea. 2023-02-16 18:01:26,648 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.76 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/hbase/meta/1588230740/.tmp/info/da34a3e430af41efa719de20f6183caf 2023-02-16 18:01:26,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/31afd44b71d5642a373135dee5b626ea/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 18:01:26,658 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea. 2023-02-16 18:01:26,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 31afd44b71d5642a373135dee5b626ea: 2023-02-16 18:01:26,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea. 2023-02-16 18:01:26,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f6fea7abf2b32dbe67a267c0cf01e593, disabling compactions & flushes 2023-02-16 18:01:26,658 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593. 2023-02-16 18:01:26,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593. 2023-02-16 18:01:26,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593. after waiting 0 ms 2023-02-16 18:01:26,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593. 2023-02-16 18:01:26,664 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/f6fea7abf2b32dbe67a267c0cf01e593/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-16 18:01:26,665 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593. 2023-02-16 18:01:26,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f6fea7abf2b32dbe67a267c0cf01e593: 2023-02-16 18:01:26,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593. 2023-02-16 18:01:26,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e155df5ccc3da2f833eca9746ce9ba33, disabling compactions & flushes 2023-02-16 18:01:26,666 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33. 2023-02-16 18:01:26,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33. 2023-02-16 18:01:26,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33. after waiting 0 ms 2023-02-16 18:01:26,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33. 2023-02-16 18:01:26,668 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/hbase/namespace/8222039b4a86ba55c0bc50e2086dd442/.tmp/info/7f99a1ff55054d0d93fb9c5cef155263 2023-02-16 18:01:26,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/e155df5ccc3da2f833eca9746ce9ba33/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-16 18:01:26,674 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/hbase/meta/1588230740/.tmp/table/af68ce93ce504309b05aaa05c5d7f375 2023-02-16 18:01:26,675 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33. 2023-02-16 18:01:26,675 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e155df5ccc3da2f833eca9746ce9ba33: 2023-02-16 18:01:26,675 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33. 2023-02-16 18:01:26,675 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing da4e4d853fcab29265a5ca41991cbfb7, disabling compactions & flushes 2023-02-16 18:01:26,675 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7. 2023-02-16 18:01:26,675 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7. 2023-02-16 18:01:26,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7. after waiting 0 ms 2023-02-16 18:01:26,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7. 2023-02-16 18:01:26,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/hbase/namespace/8222039b4a86ba55c0bc50e2086dd442/.tmp/info/7f99a1ff55054d0d93fb9c5cef155263 as hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/hbase/namespace/8222039b4a86ba55c0bc50e2086dd442/info/7f99a1ff55054d0d93fb9c5cef155263 2023-02-16 18:01:26,689 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/hbase/meta/1588230740/.tmp/info/da34a3e430af41efa719de20f6183caf as hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/hbase/meta/1588230740/info/da34a3e430af41efa719de20f6183caf 2023-02-16 18:01:26,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/da4e4d853fcab29265a5ca41991cbfb7/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 18:01:26,692 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7. 2023-02-16 18:01:26,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for da4e4d853fcab29265a5ca41991cbfb7: 2023-02-16 18:01:26,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7. 2023-02-16 18:01:26,692 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/hbase/namespace/8222039b4a86ba55c0bc50e2086dd442/info/7f99a1ff55054d0d93fb9c5cef155263, entries=2, sequenceid=6, filesize=4.8 K 2023-02-16 18:01:26,695 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 8222039b4a86ba55c0bc50e2086dd442 in 61ms, sequenceid=6, compaction requested=false 2023-02-16 18:01:26,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-16 18:01:26,698 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/hbase/meta/1588230740/info/da34a3e430af41efa719de20f6183caf, entries=110, sequenceid=32, filesize=18.7 K 2023-02-16 18:01:26,699 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/hbase/meta/1588230740/.tmp/table/af68ce93ce504309b05aaa05c5d7f375 as hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/hbase/meta/1588230740/table/af68ce93ce504309b05aaa05c5d7f375 2023-02-16 18:01:26,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/hbase/namespace/8222039b4a86ba55c0bc50e2086dd442/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-16 18:01:26,701 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676570481452.8222039b4a86ba55c0bc50e2086dd442. 2023-02-16 18:01:26,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8222039b4a86ba55c0bc50e2086dd442: 2023-02-16 18:01:26,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676570481452.8222039b4a86ba55c0bc50e2086dd442. 2023-02-16 18:01:26,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8fdec3876078f55081787f24f961828a, disabling compactions & flushes 2023-02-16 18:01:26,701 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a. 2023-02-16 18:01:26,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a. 2023-02-16 18:01:26,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a. after waiting 0 ms 2023-02-16 18:01:26,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a. 2023-02-16 18:01:26,705 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/hbase/meta/1588230740/table/af68ce93ce504309b05aaa05c5d7f375, entries=4, sequenceid=32, filesize=4.8 K 2023-02-16 18:01:26,705 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 18:01:26,706 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 18:01:26,708 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 88ms, sequenceid=32, compaction requested=false 2023-02-16 18:01:26,708 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-16 18:01:26,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/8fdec3876078f55081787f24f961828a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 18:01:26,719 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a. 2023-02-16 18:01:26,719 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8fdec3876078f55081787f24f961828a: 2023-02-16 18:01:26,719 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a. 2023-02-16 18:01:26,719 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3eb4596533e4744167c987c3f9928464, disabling compactions & flushes 2023-02-16 18:01:26,720 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676570482095.3eb4596533e4744167c987c3f9928464. 2023-02-16 18:01:26,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676570482095.3eb4596533e4744167c987c3f9928464. 2023-02-16 18:01:26,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676570482095.3eb4596533e4744167c987c3f9928464. after waiting 0 ms 2023-02-16 18:01:26,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676570482095.3eb4596533e4744167c987c3f9928464. 2023-02-16 18:01:26,729 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-16 18:01:26,730 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 18:01:26,730 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 18:01:26,730 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 18:01:26,730 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-16 18:01:26,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/3eb4596533e4744167c987c3f9928464/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 18:01:26,737 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676570482095.3eb4596533e4744167c987c3f9928464. 2023-02-16 18:01:26,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3eb4596533e4744167c987c3f9928464: 2023-02-16 18:01:26,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1676570482095.3eb4596533e4744167c987c3f9928464. 2023-02-16 18:01:26,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 19e292fb23dca311f01841f682b38f19, disabling compactions & flushes 2023-02-16 18:01:26,737 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19. 2023-02-16 18:01:26,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19. 2023-02-16 18:01:26,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19. after waiting 0 ms 2023-02-16 18:01:26,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19. 2023-02-16 18:01:26,757 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/19e292fb23dca311f01841f682b38f19/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 18:01:26,758 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19. 2023-02-16 18:01:26,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 19e292fb23dca311f01841f682b38f19: 2023-02-16 18:01:26,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19. 2023-02-16 18:01:26,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing eb6d74bacfba537526abbce930880639, disabling compactions & flushes 2023-02-16 18:01:26,758 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676570482095.eb6d74bacfba537526abbce930880639. 2023-02-16 18:01:26,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676570482095.eb6d74bacfba537526abbce930880639. 2023-02-16 18:01:26,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676570482095.eb6d74bacfba537526abbce930880639. after waiting 0 ms 2023-02-16 18:01:26,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676570482095.eb6d74bacfba537526abbce930880639. 2023-02-16 18:01:26,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/data/default/testWithMapReduce/eb6d74bacfba537526abbce930880639/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 18:01:26,767 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676570482095.eb6d74bacfba537526abbce930880639. 2023-02-16 18:01:26,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for eb6d74bacfba537526abbce930880639: 2023-02-16 18:01:26,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1676570482095.eb6d74bacfba537526abbce930880639. 2023-02-16 18:01:26,814 INFO [RS:1;jenkins-hbase4:42581] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42581,1676570480748; all regions closed. 2023-02-16 18:01:26,818 INFO [RS:0;jenkins-hbase4:40551] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40551,1676570480716; all regions closed. 2023-02-16 18:01:26,818 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/WALs/jenkins-hbase4.apache.org,42581,1676570480748/jenkins-hbase4.apache.org%2C42581%2C1676570480748.1676570482099 not finished, retry = 0 2023-02-16 18:01:26,824 DEBUG [RS:0;jenkins-hbase4:40551] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/oldWALs 2023-02-16 18:01:26,824 INFO [RS:0;jenkins-hbase4:40551] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40551%2C1676570480716.meta:.meta(num 1676570481361) 2023-02-16 18:01:26,836 DEBUG [RS:0;jenkins-hbase4:40551] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/oldWALs 2023-02-16 18:01:26,836 INFO [RS:0;jenkins-hbase4:40551] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40551%2C1676570480716:(num 1676570481902) 2023-02-16 18:01:26,836 DEBUG [RS:0;jenkins-hbase4:40551] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:26,837 INFO [RS:0;jenkins-hbase4:40551] regionserver.LeaseManager(133): Closed leases 2023-02-16 18:01:26,837 INFO [RS:0;jenkins-hbase4:40551] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-16 18:01:26,837 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 18:01:26,838 INFO [RS:0;jenkins-hbase4:40551] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40551 2023-02-16 18:01:26,842 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:26,842 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1005e4b39ac0002, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:26,842 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x1005e4b39ac0001, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40551,1676570480716 2023-02-16 18:01:26,842 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1005e4b39ac0002, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:26,843 ERROR [Listener at localhost/46409-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1a633a92 rejected from java.util.concurrent.ThreadPoolExecutor@1e5cbd06[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:26,843 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x1005e4b39ac0001, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:26,843 ERROR [Listener at localhost/46409-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@69fb4ad2 rejected from java.util.concurrent.ThreadPoolExecutor@1e5cbd06[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:26,843 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40551,1676570480716] 2023-02-16 18:01:26,843 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40551,1676570480716; numProcessing=1 2023-02-16 18:01:26,845 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40551,1676570480716 already deleted, retry=false 2023-02-16 18:01:26,845 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40551,1676570480716 expired; onlineServers=1 2023-02-16 18:01:26,921 DEBUG [RS:1;jenkins-hbase4:42581] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/oldWALs 2023-02-16 18:01:26,921 INFO [RS:1;jenkins-hbase4:42581] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42581%2C1676570480748:(num 1676570482099) 2023-02-16 18:01:26,921 DEBUG [RS:1;jenkins-hbase4:42581] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:26,921 INFO [RS:1;jenkins-hbase4:42581] regionserver.LeaseManager(133): Closed leases 2023-02-16 18:01:26,922 INFO [RS:1;jenkins-hbase4:42581] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-16 18:01:26,922 INFO [RS:1;jenkins-hbase4:42581] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 18:01:26,922 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 18:01:26,922 INFO [RS:1;jenkins-hbase4:42581] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 18:01:26,922 INFO [RS:1;jenkins-hbase4:42581] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 18:01:26,923 INFO [RS:1;jenkins-hbase4:42581] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42581 2023-02-16 18:01:26,928 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1005e4b39ac0002, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42581,1676570480748 2023-02-16 18:01:26,928 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:26,928 ERROR [Listener at localhost/46409-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2d9885ad rejected from java.util.concurrent.ThreadPoolExecutor@29a704c6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:26,929 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42581,1676570480748] 2023-02-16 18:01:26,929 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42581,1676570480748; numProcessing=2 2023-02-16 18:01:26,930 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42581,1676570480748 already deleted, retry=false 2023-02-16 18:01:26,930 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42581,1676570480748 expired; onlineServers=0 2023-02-16 18:01:26,930 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45927,1676570480648' ***** 2023-02-16 18:01:26,930 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-16 18:01:26,931 DEBUG [M:0;jenkins-hbase4:45927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@581edf25, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 18:01:26,931 INFO [M:0;jenkins-hbase4:45927] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45927,1676570480648 2023-02-16 18:01:26,931 INFO [M:0;jenkins-hbase4:45927] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45927,1676570480648; all regions closed. 2023-02-16 18:01:26,931 DEBUG [M:0;jenkins-hbase4:45927] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:26,931 DEBUG [M:0;jenkins-hbase4:45927] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-16 18:01:26,931 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-16 18:01:26,931 DEBUG [M:0;jenkins-hbase4:45927] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-16 18:01:26,931 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676570480956] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676570480956,5,FailOnTimeoutGroup] 2023-02-16 18:01:26,931 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676570480948] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676570480948,5,FailOnTimeoutGroup] 2023-02-16 18:01:26,932 INFO [M:0;jenkins-hbase4:45927] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-16 18:01:26,932 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-16 18:01:26,932 INFO [M:0;jenkins-hbase4:45927] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-16 18:01:26,933 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:26,933 INFO [M:0;jenkins-hbase4:45927] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-16 18:01:26,933 DEBUG [M:0;jenkins-hbase4:45927] master.HMaster(1512): Stopping service threads 2023-02-16 18:01:26,933 INFO [M:0;jenkins-hbase4:45927] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-16 18:01:26,933 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 18:01:26,933 ERROR [M:0;jenkins-hbase4:45927] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-16 18:01:26,933 INFO [M:0;jenkins-hbase4:45927] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-16 18:01:26,934 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-16 18:01:26,934 DEBUG [M:0;jenkins-hbase4:45927] zookeeper.ZKUtil(398): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-16 18:01:26,934 WARN [M:0;jenkins-hbase4:45927] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-16 18:01:26,934 INFO [M:0;jenkins-hbase4:45927] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-16 18:01:26,934 INFO [M:0;jenkins-hbase4:45927] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-16 18:01:26,935 DEBUG [M:0;jenkins-hbase4:45927] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 18:01:26,935 INFO [M:0;jenkins-hbase4:45927] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:26,935 DEBUG [M:0;jenkins-hbase4:45927] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:26,935 DEBUG [M:0;jenkins-hbase4:45927] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 18:01:26,935 DEBUG [M:0;jenkins-hbase4:45927] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:26,935 INFO [M:0;jenkins-hbase4:45927] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=100.96 KB heapSize=120.63 KB 2023-02-16 18:01:26,945 INFO [M:0;jenkins-hbase4:45927] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=100.96 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/739e69ebe29549c5ba3877f5d63c4e90 2023-02-16 18:01:26,951 DEBUG [M:0;jenkins-hbase4:45927] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/739e69ebe29549c5ba3877f5d63c4e90 as hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/739e69ebe29549c5ba3877f5d63c4e90 2023-02-16 18:01:26,957 INFO [M:0;jenkins-hbase4:45927] regionserver.HStore(1080): Added hdfs://localhost:43277/user/jenkins/test-data/320427ba-b882-90df-d036-e2c2a96a227f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/739e69ebe29549c5ba3877f5d63c4e90, entries=31, sequenceid=218, filesize=9.0 K 2023-02-16 18:01:26,958 INFO [M:0;jenkins-hbase4:45927] regionserver.HRegion(2947): Finished flush of dataSize ~100.96 KB/103386, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 23ms, sequenceid=218, compaction requested=false 2023-02-16 18:01:26,960 INFO [M:0;jenkins-hbase4:45927] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:26,961 DEBUG [M:0;jenkins-hbase4:45927] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 18:01:26,988 INFO [M:0;jenkins-hbase4:45927] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-16 18:01:26,988 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 18:01:26,989 INFO [M:0;jenkins-hbase4:45927] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45927 2023-02-16 18:01:26,993 DEBUG [M:0;jenkins-hbase4:45927] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,45927,1676570480648 already deleted, retry=false 2023-02-16 18:01:27,108 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:27,108 INFO [M:0;jenkins-hbase4:45927] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45927,1676570480648; zookeeper connection closed. 2023-02-16 18:01:27,108 ERROR [Listener at localhost/46409-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1f328faf rejected from java.util.concurrent.ThreadPoolExecutor@1b0d1891[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:27,109 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): master:45927-0x1005e4b39ac0000, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:27,109 ERROR [Listener at localhost/46409-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@64df8fcf rejected from java.util.concurrent.ThreadPoolExecutor@1b0d1891[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:27,208 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1005e4b39ac0002, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:27,208 INFO [RS:1;jenkins-hbase4:42581] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42581,1676570480748; zookeeper connection closed. 2023-02-16 18:01:27,209 ERROR [Listener at localhost/46409-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@34df7f6b rejected from java.util.concurrent.ThreadPoolExecutor@29a704c6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:27,209 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1005e4b39ac0002, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:27,209 ERROR [Listener at localhost/46409-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4c138ff2 rejected from java.util.concurrent.ThreadPoolExecutor@29a704c6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:27,210 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@c73fcc2] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@c73fcc2 2023-02-16 18:01:27,309 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x1005e4b39ac0001, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:27,309 INFO [RS:0;jenkins-hbase4:40551] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40551,1676570480716; zookeeper connection closed. 2023-02-16 18:01:27,309 ERROR [Listener at localhost/46409-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@11006e17 rejected from java.util.concurrent.ThreadPoolExecutor@1e5cbd06[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:27,309 DEBUG [Listener at localhost/46409-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x1005e4b39ac0001, quorum=127.0.0.1:51931, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:27,309 ERROR [Listener at localhost/46409-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@8efaf80 rejected from java.util.concurrent.ThreadPoolExecutor@1e5cbd06[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:27,309 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@39848aed] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@39848aed 2023-02-16 18:01:27,310 INFO [Listener at localhost/46409] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-16 18:01:27,404 DEBUG [Listener at localhost/46409] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d/hadoop-3720237880885921956.jar 2023-02-16 18:01:27,409 INFO [Listener at localhost/46409] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676570484489 type: FLUSH version: 2 ttl: 0 2023-02-16 18:01:27,409 DEBUG [Listener at localhost/46409] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33/data/default/testWithMapReduce 2023-02-16 18:01:27,410 INFO [Listener at localhost/46409] snapshot.RestoreSnapshotHelper(239): region to add: 31afd44b71d5642a373135dee5b626ea 2023-02-16 18:01:27,410 INFO [Listener at localhost/46409] snapshot.RestoreSnapshotHelper(239): region to add: ff112adcde372b676d79e75223744fae 2023-02-16 18:01:27,410 INFO [Listener at localhost/46409] snapshot.RestoreSnapshotHelper(239): region to add: d429632777f89bb78e78ce013de08e64 2023-02-16 18:01:27,410 INFO [Listener at localhost/46409] snapshot.RestoreSnapshotHelper(239): region to add: 8fdec3876078f55081787f24f961828a 2023-02-16 18:01:27,410 INFO [Listener at localhost/46409] snapshot.RestoreSnapshotHelper(239): region to add: f6fea7abf2b32dbe67a267c0cf01e593 2023-02-16 18:01:27,410 INFO [Listener at localhost/46409] snapshot.RestoreSnapshotHelper(239): region to add: 3eb4596533e4744167c987c3f9928464 2023-02-16 18:01:27,410 INFO [Listener at localhost/46409] snapshot.RestoreSnapshotHelper(239): region to add: 19e292fb23dca311f01841f682b38f19 2023-02-16 18:01:27,410 INFO [Listener at localhost/46409] snapshot.RestoreSnapshotHelper(239): region to add: eb6d74bacfba537526abbce930880639 2023-02-16 18:01:27,410 INFO [Listener at localhost/46409] snapshot.RestoreSnapshotHelper(239): region to add: da4e4d853fcab29265a5ca41991cbfb7 2023-02-16 18:01:27,410 INFO [Listener at localhost/46409] snapshot.RestoreSnapshotHelper(239): region to add: e155df5ccc3da2f833eca9746ce9ba33 2023-02-16 18:01:27,410 INFO [Listener at localhost/46409] snapshot.RestoreSnapshotHelper(585): clone region=31afd44b71d5642a373135dee5b626ea as 31afd44b71d5642a373135dee5b626ea in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:27,410 INFO [Listener at localhost/46409] snapshot.RestoreSnapshotHelper(585): clone region=ff112adcde372b676d79e75223744fae as ff112adcde372b676d79e75223744fae in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:27,410 INFO [Listener at localhost/46409] snapshot.RestoreSnapshotHelper(585): clone region=d429632777f89bb78e78ce013de08e64 as d429632777f89bb78e78ce013de08e64 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:27,410 INFO [Listener at localhost/46409] snapshot.RestoreSnapshotHelper(585): clone region=8fdec3876078f55081787f24f961828a as 8fdec3876078f55081787f24f961828a in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:27,410 INFO [Listener at localhost/46409] snapshot.RestoreSnapshotHelper(585): clone region=f6fea7abf2b32dbe67a267c0cf01e593 as f6fea7abf2b32dbe67a267c0cf01e593 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:27,410 INFO [Listener at localhost/46409] snapshot.RestoreSnapshotHelper(585): clone region=3eb4596533e4744167c987c3f9928464 as 3eb4596533e4744167c987c3f9928464 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:27,410 INFO [Listener at localhost/46409] snapshot.RestoreSnapshotHelper(585): clone region=19e292fb23dca311f01841f682b38f19 as 19e292fb23dca311f01841f682b38f19 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:27,411 INFO [Listener at localhost/46409] snapshot.RestoreSnapshotHelper(585): clone region=eb6d74bacfba537526abbce930880639 as eb6d74bacfba537526abbce930880639 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:27,411 INFO [Listener at localhost/46409] snapshot.RestoreSnapshotHelper(585): clone region=da4e4d853fcab29265a5ca41991cbfb7 as da4e4d853fcab29265a5ca41991cbfb7 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:27,411 INFO [Listener at localhost/46409] snapshot.RestoreSnapshotHelper(585): clone region=e155df5ccc3da2f833eca9746ce9ba33 as e155df5ccc3da2f833eca9746ce9ba33 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 18:01:27,412 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => ff112adcde372b676d79e75223744fae, NAME => 'testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33 2023-02-16 18:01:27,412 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => d429632777f89bb78e78ce013de08e64, NAME => 'testWithMapReduce,q\x11\x10,1676570482095.d429632777f89bb78e78ce013de08e64.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33 2023-02-16 18:01:27,413 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 3eb4596533e4744167c987c3f9928464, NAME => 'testWithMapReduce,d\x84\x84,1676570482095.3eb4596533e4744167c987c3f9928464.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33 2023-02-16 18:01:27,413 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 8fdec3876078f55081787f24f961828a, NAME => 'testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33 2023-02-16 18:01:27,413 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => f6fea7abf2b32dbe67a267c0cf01e593, NAME => 'testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33 2023-02-16 18:01:27,413 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 31afd44b71d5642a373135dee5b626ea, NAME => 'testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33 2023-02-16 18:01:27,416 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => eb6d74bacfba537526abbce930880639, NAME => 'testWithMapReduce,g\xA7\xA7,1676570482095.eb6d74bacfba537526abbce930880639.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33 2023-02-16 18:01:27,417 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 19e292fb23dca311f01841f682b38f19, NAME => 'testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33 2023-02-16 18:01:27,432 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676570482095.3eb4596533e4744167c987c3f9928464.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:27,432 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 341d4fc09afc45fab7fbcf2e783cf557 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 18:01:27,433 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:27,433 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8e8c6673b85b4b3f86bd4b6f1f1b22b4 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 18:01:27,433 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:27,433 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f4a04c12fd7240f89fb2fbfbef900f63 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 18:01:27,434 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:27,434 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c57bb23fd31b4c15b7b66ed66423e384 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 18:01:27,435 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676570482095.eb6d74bacfba537526abbce930880639.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:27,435 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6c913cd5d86a4f12a25a07bc0db3c3d0 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 18:01:27,436 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:27,437 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing f6fea7abf2b32dbe67a267c0cf01e593, disabling compactions & flushes 2023-02-16 18:01:27,437 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593. 2023-02-16 18:01:27,437 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593. 2023-02-16 18:01:27,437 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6cb006f635694c5683e7e2aa6138a91b from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 18:01:27,437 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593. after waiting 0 ms 2023-02-16 18:01:27,437 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593. 2023-02-16 18:01:27,437 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593. 2023-02-16 18:01:27,437 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for f6fea7abf2b32dbe67a267c0cf01e593: 2023-02-16 18:01:27,438 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => da4e4d853fcab29265a5ca41991cbfb7, NAME => 'testWithMapReduce,m\xED\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33 2023-02-16 18:01:27,444 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7bd5b25253694d24863e2c1c9e799146 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 18:01:27,444 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676570482095.d429632777f89bb78e78ce013de08e64.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:27,444 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e3929f2f85dc4537b631ec7078523243 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 18:01:27,444 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c42b33ed15a6458abd71bde06f429dcd from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 18:01:27,445 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d3aa4d87925e494c881d5479ae7d79c1 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 18:01:27,445 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9ddd60fec49e420b89cdc2352093996a from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 18:01:27,446 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 3eb4596533e4744167c987c3f9928464, disabling compactions & flushes 2023-02-16 18:01:27,446 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676570482095.3eb4596533e4744167c987c3f9928464. 2023-02-16 18:01:27,446 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676570482095.3eb4596533e4744167c987c3f9928464. 2023-02-16 18:01:27,446 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676570482095.3eb4596533e4744167c987c3f9928464. after waiting 0 ms 2023-02-16 18:01:27,446 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676570482095.3eb4596533e4744167c987c3f9928464. 2023-02-16 18:01:27,446 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676570482095.3eb4596533e4744167c987c3f9928464. 2023-02-16 18:01:27,446 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 3eb4596533e4744167c987c3f9928464: 2023-02-16 18:01:27,447 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => e155df5ccc3da2f833eca9746ce9ba33, NAME => 'testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33 2023-02-16 18:01:27,448 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 675e72cb4e724f8ba7b118ee3b6e0b59 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 18:01:27,449 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 31afd44b71d5642a373135dee5b626ea, disabling compactions & flushes 2023-02-16 18:01:27,449 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea. 2023-02-16 18:01:27,449 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea. 2023-02-16 18:01:27,449 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 19e292fb23dca311f01841f682b38f19, disabling compactions & flushes 2023-02-16 18:01:27,449 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea. after waiting 0 ms 2023-02-16 18:01:27,449 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19. 2023-02-16 18:01:27,449 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea. 2023-02-16 18:01:27,449 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing eb6d74bacfba537526abbce930880639, disabling compactions & flushes 2023-02-16 18:01:27,449 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea. 2023-02-16 18:01:27,449 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 8fdec3876078f55081787f24f961828a, disabling compactions & flushes 2023-02-16 18:01:27,449 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19. 2023-02-16 18:01:27,450 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a. 2023-02-16 18:01:27,450 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 31afd44b71d5642a373135dee5b626ea: 2023-02-16 18:01:27,449 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676570482095.eb6d74bacfba537526abbce930880639. 2023-02-16 18:01:27,450 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a. 2023-02-16 18:01:27,450 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19. after waiting 0 ms 2023-02-16 18:01:27,450 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a. after waiting 0 ms 2023-02-16 18:01:27,450 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676570482095.eb6d74bacfba537526abbce930880639. 2023-02-16 18:01:27,450 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a. 2023-02-16 18:01:27,450 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19. 2023-02-16 18:01:27,450 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19. 2023-02-16 18:01:27,450 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 19e292fb23dca311f01841f682b38f19: 2023-02-16 18:01:27,450 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a. 2023-02-16 18:01:27,450 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676570482095.eb6d74bacfba537526abbce930880639. after waiting 0 ms 2023-02-16 18:01:27,450 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 8fdec3876078f55081787f24f961828a: 2023-02-16 18:01:27,450 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676570482095.eb6d74bacfba537526abbce930880639. 2023-02-16 18:01:27,450 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676570482095.eb6d74bacfba537526abbce930880639. 2023-02-16 18:01:27,450 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for eb6d74bacfba537526abbce930880639: 2023-02-16 18:01:27,456 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing d429632777f89bb78e78ce013de08e64, disabling compactions & flushes 2023-02-16 18:01:27,456 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676570482095.d429632777f89bb78e78ce013de08e64. 2023-02-16 18:01:27,456 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676570482095.d429632777f89bb78e78ce013de08e64. 2023-02-16 18:01:27,456 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676570482095.d429632777f89bb78e78ce013de08e64. after waiting 0 ms 2023-02-16 18:01:27,456 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676570482095.d429632777f89bb78e78ce013de08e64. 2023-02-16 18:01:27,456 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676570482095.d429632777f89bb78e78ce013de08e64. 2023-02-16 18:01:27,456 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for d429632777f89bb78e78ce013de08e64: 2023-02-16 18:01:27,458 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:27,458 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1bd91146f26142cfad10b726e7ea7d30 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 18:01:27,460 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:27,460 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing e155df5ccc3da2f833eca9746ce9ba33, disabling compactions & flushes 2023-02-16 18:01:27,460 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6f3ae422c9394771b0047f5d8a0f93fa from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 18:01:27,460 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33. 2023-02-16 18:01:27,461 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33. 2023-02-16 18:01:27,461 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33. after waiting 0 ms 2023-02-16 18:01:27,461 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33. 2023-02-16 18:01:27,461 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33. 2023-02-16 18:01:27,461 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for e155df5ccc3da2f833eca9746ce9ba33: 2023-02-16 18:01:27,462 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing da4e4d853fcab29265a5ca41991cbfb7, disabling compactions & flushes 2023-02-16 18:01:27,462 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7. 2023-02-16 18:01:27,462 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7. 2023-02-16 18:01:27,462 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7. after waiting 0 ms 2023-02-16 18:01:27,463 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7. 2023-02-16 18:01:27,463 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7. 2023-02-16 18:01:27,463 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for da4e4d853fcab29265a5ca41991cbfb7: 2023-02-16 18:01:27,831 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:27,832 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 801563733c2f41b2846d6530c3d87ad9 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 18:01:27,834 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 791df0b395a24ce3bd1323aadd628fa6 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 18:01:27,836 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing ff112adcde372b676d79e75223744fae, disabling compactions & flushes 2023-02-16 18:01:27,836 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae. 2023-02-16 18:01:27,836 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae. 2023-02-16 18:01:27,836 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae. after waiting 0 ms 2023-02-16 18:01:27,836 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae. 2023-02-16 18:01:27,836 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae. 2023-02-16 18:01:27,836 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for ff112adcde372b676d79e75223744fae: 2023-02-16 18:01:27,837 INFO [Listener at localhost/46409] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676570484489 type: FLUSH version: 2 ttl: 0 2023-02-16 18:01:27,837 DEBUG [Listener at localhost/46409] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33 2023-02-16 18:01:27,837 DEBUG [Listener at localhost/46409] util.CommonFSUtils(682): File system contents for path hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33 2023-02-16 18:01:27,838 DEBUG [Listener at localhost/46409] util.CommonFSUtils(699): |-data/ 2023-02-16 18:01:27,838 DEBUG [Listener at localhost/46409] util.CommonFSUtils(699): |----default/ 2023-02-16 18:01:27,839 DEBUG [Listener at localhost/46409] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-16 18:01:27,839 DEBUG [Listener at localhost/46409] util.CommonFSUtils(699): |----------19e292fb23dca311f01841f682b38f19/ 2023-02-16 18:01:27,840 DEBUG [Listener at localhost/46409] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 18:01:27,840 DEBUG [Listener at localhost/46409] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 18:01:27,840 DEBUG [Listener at localhost/46409] util.CommonFSUtils(702): |----------------testWithMapReduce=19e292fb23dca311f01841f682b38f19-c57bb23fd31b4c15b7b66ed66423e384 2023-02-16 18:01:27,840 DEBUG [Listener at localhost/46409] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 18:01:27,841 DEBUG [Listener at localhost/46409] util.CommonFSUtils(702): |----------------testWithMapReduce=19e292fb23dca311f01841f682b38f19-9ddd60fec49e420b89cdc2352093996a 2023-02-16 18:01:27,841 DEBUG [Listener at localhost/46409] util.CommonFSUtils(699): |----------31afd44b71d5642a373135dee5b626ea/ 2023-02-16 18:01:27,841 DEBUG [Listener at localhost/46409] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 18:01:27,841 DEBUG [Listener at localhost/46409] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 18:01:27,842 DEBUG [Listener at localhost/46409] util.CommonFSUtils(702): |----------------testWithMapReduce=31afd44b71d5642a373135dee5b626ea-f4a04c12fd7240f89fb2fbfbef900f63 2023-02-16 18:01:27,842 DEBUG [Listener at localhost/46409] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 18:01:27,842 DEBUG [Listener at localhost/46409] util.CommonFSUtils(702): |----------------testWithMapReduce=31afd44b71d5642a373135dee5b626ea-c42b33ed15a6458abd71bde06f429dcd 2023-02-16 18:01:27,842 DEBUG [Listener at localhost/46409] util.CommonFSUtils(699): |----------3eb4596533e4744167c987c3f9928464/ 2023-02-16 18:01:27,843 DEBUG [Listener at localhost/46409] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 18:01:27,843 DEBUG [Listener at localhost/46409] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 18:01:27,843 DEBUG [Listener at localhost/46409] util.CommonFSUtils(702): |----------------testWithMapReduce=3eb4596533e4744167c987c3f9928464-341d4fc09afc45fab7fbcf2e783cf557 2023-02-16 18:01:27,843 DEBUG [Listener at localhost/46409] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 18:01:27,844 DEBUG [Listener at localhost/46409] util.CommonFSUtils(702): |----------------testWithMapReduce=3eb4596533e4744167c987c3f9928464-6cb006f635694c5683e7e2aa6138a91b 2023-02-16 18:01:27,844 DEBUG [Listener at localhost/46409] util.CommonFSUtils(699): |----------8fdec3876078f55081787f24f961828a/ 2023-02-16 18:01:27,844 DEBUG [Listener at localhost/46409] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 18:01:27,844 DEBUG [Listener at localhost/46409] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 18:01:27,845 DEBUG [Listener at localhost/46409] util.CommonFSUtils(702): |----------------testWithMapReduce=8fdec3876078f55081787f24f961828a-8e8c6673b85b4b3f86bd4b6f1f1b22b4 2023-02-16 18:01:27,845 DEBUG [Listener at localhost/46409] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 18:01:27,845 DEBUG [Listener at localhost/46409] util.CommonFSUtils(702): |----------------testWithMapReduce=8fdec3876078f55081787f24f961828a-7bd5b25253694d24863e2c1c9e799146 2023-02-16 18:01:27,845 DEBUG [Listener at localhost/46409] util.CommonFSUtils(699): |----------d429632777f89bb78e78ce013de08e64/ 2023-02-16 18:01:27,846 DEBUG [Listener at localhost/46409] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 18:01:27,846 DEBUG [Listener at localhost/46409] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 18:01:27,846 DEBUG [Listener at localhost/46409] util.CommonFSUtils(702): |----------------testWithMapReduce=d429632777f89bb78e78ce013de08e64-e3929f2f85dc4537b631ec7078523243 2023-02-16 18:01:27,846 DEBUG [Listener at localhost/46409] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 18:01:27,847 DEBUG [Listener at localhost/46409] util.CommonFSUtils(702): |----------------testWithMapReduce=d429632777f89bb78e78ce013de08e64-675e72cb4e724f8ba7b118ee3b6e0b59 2023-02-16 18:01:27,847 DEBUG [Listener at localhost/46409] util.CommonFSUtils(699): |----------da4e4d853fcab29265a5ca41991cbfb7/ 2023-02-16 18:01:27,847 DEBUG [Listener at localhost/46409] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 18:01:27,847 DEBUG [Listener at localhost/46409] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 18:01:27,848 DEBUG [Listener at localhost/46409] util.CommonFSUtils(702): |----------------testWithMapReduce=da4e4d853fcab29265a5ca41991cbfb7-1bd91146f26142cfad10b726e7ea7d30 2023-02-16 18:01:27,848 DEBUG [Listener at localhost/46409] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 18:01:27,848 DEBUG [Listener at localhost/46409] util.CommonFSUtils(702): |----------------testWithMapReduce=da4e4d853fcab29265a5ca41991cbfb7-6f3ae422c9394771b0047f5d8a0f93fa 2023-02-16 18:01:27,848 DEBUG [Listener at localhost/46409] util.CommonFSUtils(699): |----------e155df5ccc3da2f833eca9746ce9ba33/ 2023-02-16 18:01:27,849 DEBUG [Listener at localhost/46409] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 18:01:27,849 DEBUG [Listener at localhost/46409] util.CommonFSUtils(699): |----------eb6d74bacfba537526abbce930880639/ 2023-02-16 18:01:27,849 DEBUG [Listener at localhost/46409] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 18:01:27,849 DEBUG [Listener at localhost/46409] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 18:01:27,850 DEBUG [Listener at localhost/46409] util.CommonFSUtils(702): |----------------testWithMapReduce=eb6d74bacfba537526abbce930880639-6c913cd5d86a4f12a25a07bc0db3c3d0 2023-02-16 18:01:27,850 DEBUG [Listener at localhost/46409] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 18:01:27,850 DEBUG [Listener at localhost/46409] util.CommonFSUtils(702): |----------------testWithMapReduce=eb6d74bacfba537526abbce930880639-d3aa4d87925e494c881d5479ae7d79c1 2023-02-16 18:01:27,850 DEBUG [Listener at localhost/46409] util.CommonFSUtils(699): |----------f6fea7abf2b32dbe67a267c0cf01e593/ 2023-02-16 18:01:27,851 DEBUG [Listener at localhost/46409] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 18:01:27,851 DEBUG [Listener at localhost/46409] util.CommonFSUtils(699): |----------ff112adcde372b676d79e75223744fae/ 2023-02-16 18:01:27,851 DEBUG [Listener at localhost/46409] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 18:01:27,851 DEBUG [Listener at localhost/46409] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 18:01:27,851 DEBUG [Listener at localhost/46409] util.CommonFSUtils(702): |----------------testWithMapReduce=ff112adcde372b676d79e75223744fae-801563733c2f41b2846d6530c3d87ad9 2023-02-16 18:01:27,852 DEBUG [Listener at localhost/46409] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 18:01:27,852 DEBUG [Listener at localhost/46409] util.CommonFSUtils(702): |----------------testWithMapReduce=ff112adcde372b676d79e75223744fae-791df0b395a24ce3bd1323aadd628fa6 2023-02-16 18:01:27,852 DEBUG [Listener at localhost/46409] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:27,853 DEBUG [Listener at localhost/46409] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:27,853 DEBUG [Listener at localhost/46409] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:27,853 DEBUG [Listener at localhost/46409] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:27,854 DEBUG [Listener at localhost/46409] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:27,854 DEBUG [Listener at localhost/46409] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:27,854 DEBUG [Listener at localhost/46409] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:27,921 DEBUG [Listener at localhost/46409] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d/hadoop-6921179894506922888.jar 2023-02-16 18:01:27,922 DEBUG [Listener at localhost/46409] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:27,922 DEBUG [Listener at localhost/46409] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:27,923 DEBUG [Listener at localhost/46409] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:27,923 DEBUG [Listener at localhost/46409] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:27,924 DEBUG [Listener at localhost/46409] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:27,924 DEBUG [Listener at localhost/46409] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:27,925 DEBUG [Listener at localhost/46409] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-16 18:01:27,925 DEBUG [Listener at localhost/46409] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-16 18:01:27,926 DEBUG [Listener at localhost/46409] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-16 18:01:27,926 DEBUG [Listener at localhost/46409] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-16 18:01:27,927 DEBUG [Listener at localhost/46409] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-16 18:01:27,928 DEBUG [Listener at localhost/46409] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-16 18:01:27,928 DEBUG [Listener at localhost/46409] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-16 18:01:27,928 DEBUG [Listener at localhost/46409] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-16 18:01:27,929 DEBUG [Listener at localhost/46409] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-16 18:01:27,929 DEBUG [Listener at localhost/46409] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-16 18:01:27,930 DEBUG [Listener at localhost/46409] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:27,930 DEBUG [Listener at localhost/46409] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 18:01:27,930 DEBUG [Listener at localhost/46409] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 18:01:27,931 DEBUG [Listener at localhost/46409] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 18:01:27,931 DEBUG [Listener at localhost/46409] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-16 18:01:27,997 DEBUG [Listener at localhost/46409] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d/hadoop-7555365485951493698.jar 2023-02-16 18:01:27,997 DEBUG [Listener at localhost/46409] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-16 18:01:28,003 WARN [Listener at localhost/46409] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-16 18:01:28,033 INFO [Listener at localhost/46409] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-16 18:01:28,139 WARN [Listener at localhost/46409] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d/mapreduce.cluster.local.dir/1676570488101/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-16 18:01:28,139 WARN [Listener at localhost/46409] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d/mapreduce.cluster.local.dir/1676570488101/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-16 18:01:28,184 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:28,184 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 18:01:28,188 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:28,190 INFO [StoreOpener-19e292fb23dca311f01841f682b38f19-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 19e292fb23dca311f01841f682b38f19 2023-02-16 18:01:28,191 DEBUG [StoreOpener-19e292fb23dca311f01841f682b38f19-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33/data/default/testWithMapReduce/19e292fb23dca311f01841f682b38f19/f1 2023-02-16 18:01:28,191 INFO [StoreOpener-19e292fb23dca311f01841f682b38f19-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 19e292fb23dca311f01841f682b38f19 columnFamilyName f1 2023-02-16 18:01:28,196 DEBUG [StoreOpener-19e292fb23dca311f01841f682b38f19-1] regionserver.HStore(539): loaded hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33/data/default/testWithMapReduce/19e292fb23dca311f01841f682b38f19/f1/testWithMapReduce=19e292fb23dca311f01841f682b38f19-c57bb23fd31b4c15b7b66ed66423e384 2023-02-16 18:01:28,196 INFO [StoreOpener-19e292fb23dca311f01841f682b38f19-1] regionserver.HStore(310): Store=19e292fb23dca311f01841f682b38f19/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:28,196 INFO [StoreOpener-19e292fb23dca311f01841f682b38f19-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 19e292fb23dca311f01841f682b38f19 2023-02-16 18:01:28,197 DEBUG [StoreOpener-19e292fb23dca311f01841f682b38f19-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33/data/default/testWithMapReduce/19e292fb23dca311f01841f682b38f19/f2 2023-02-16 18:01:28,198 INFO [StoreOpener-19e292fb23dca311f01841f682b38f19-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 19e292fb23dca311f01841f682b38f19 columnFamilyName f2 2023-02-16 18:01:28,202 DEBUG [StoreOpener-19e292fb23dca311f01841f682b38f19-1] regionserver.HStore(539): loaded hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33/data/default/testWithMapReduce/19e292fb23dca311f01841f682b38f19/f2/testWithMapReduce=19e292fb23dca311f01841f682b38f19-9ddd60fec49e420b89cdc2352093996a 2023-02-16 18:01:28,202 INFO [StoreOpener-19e292fb23dca311f01841f682b38f19-1] regionserver.HStore(310): Store=19e292fb23dca311f01841f682b38f19/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:28,202 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:28,203 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 19e292fb23dca311f01841f682b38f19; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72233978, jitterRate=0.07637014985084534}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:28,203 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 19e292fb23dca311f01841f682b38f19: 2023-02-16 18:01:28,238 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 19e292fb23dca311f01841f682b38f19, disabling compactions & flushes 2023-02-16 18:01:28,238 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19. 2023-02-16 18:01:28,238 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19. 2023-02-16 18:01:28,238 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19. after waiting 0 ms 2023-02-16 18:01:28,238 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19. 2023-02-16 18:01:28,240 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676570482095.19e292fb23dca311f01841f682b38f19. 2023-02-16 18:01:28,240 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 19e292fb23dca311f01841f682b38f19: 2023-02-16 18:01:28,243 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676570482095.3eb4596533e4744167c987c3f9928464.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:28,243 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 18:01:28,244 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:28,248 INFO [StoreOpener-3eb4596533e4744167c987c3f9928464-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3eb4596533e4744167c987c3f9928464 2023-02-16 18:01:28,249 DEBUG [StoreOpener-3eb4596533e4744167c987c3f9928464-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33/data/default/testWithMapReduce/3eb4596533e4744167c987c3f9928464/f1 2023-02-16 18:01:28,250 INFO [StoreOpener-3eb4596533e4744167c987c3f9928464-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3eb4596533e4744167c987c3f9928464 columnFamilyName f1 2023-02-16 18:01:28,254 DEBUG [StoreOpener-3eb4596533e4744167c987c3f9928464-1] regionserver.HStore(539): loaded hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33/data/default/testWithMapReduce/3eb4596533e4744167c987c3f9928464/f1/testWithMapReduce=3eb4596533e4744167c987c3f9928464-341d4fc09afc45fab7fbcf2e783cf557 2023-02-16 18:01:28,254 INFO [StoreOpener-3eb4596533e4744167c987c3f9928464-1] regionserver.HStore(310): Store=3eb4596533e4744167c987c3f9928464/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:28,254 INFO [StoreOpener-3eb4596533e4744167c987c3f9928464-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3eb4596533e4744167c987c3f9928464 2023-02-16 18:01:28,255 DEBUG [StoreOpener-3eb4596533e4744167c987c3f9928464-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33/data/default/testWithMapReduce/3eb4596533e4744167c987c3f9928464/f2 2023-02-16 18:01:28,255 INFO [StoreOpener-3eb4596533e4744167c987c3f9928464-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3eb4596533e4744167c987c3f9928464 columnFamilyName f2 2023-02-16 18:01:28,260 DEBUG [StoreOpener-3eb4596533e4744167c987c3f9928464-1] regionserver.HStore(539): loaded hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33/data/default/testWithMapReduce/3eb4596533e4744167c987c3f9928464/f2/testWithMapReduce=3eb4596533e4744167c987c3f9928464-6cb006f635694c5683e7e2aa6138a91b 2023-02-16 18:01:28,260 INFO [StoreOpener-3eb4596533e4744167c987c3f9928464-1] regionserver.HStore(310): Store=3eb4596533e4744167c987c3f9928464/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:28,260 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:28,260 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 3eb4596533e4744167c987c3f9928464; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60685956, jitterRate=-0.09570878744125366}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:28,260 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 3eb4596533e4744167c987c3f9928464: 2023-02-16 18:01:28,287 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 3eb4596533e4744167c987c3f9928464, disabling compactions & flushes 2023-02-16 18:01:28,287 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676570482095.3eb4596533e4744167c987c3f9928464. 2023-02-16 18:01:28,287 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676570482095.3eb4596533e4744167c987c3f9928464. 2023-02-16 18:01:28,287 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676570482095.3eb4596533e4744167c987c3f9928464. after waiting 0 ms 2023-02-16 18:01:28,287 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676570482095.3eb4596533e4744167c987c3f9928464. 2023-02-16 18:01:28,288 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676570482095.3eb4596533e4744167c987c3f9928464. 2023-02-16 18:01:28,288 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 3eb4596533e4744167c987c3f9928464: 2023-02-16 18:01:28,291 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:28,292 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 18:01:28,293 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:28,294 INFO [StoreOpener-da4e4d853fcab29265a5ca41991cbfb7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region da4e4d853fcab29265a5ca41991cbfb7 2023-02-16 18:01:28,295 DEBUG [StoreOpener-da4e4d853fcab29265a5ca41991cbfb7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33/data/default/testWithMapReduce/da4e4d853fcab29265a5ca41991cbfb7/f1 2023-02-16 18:01:28,295 INFO [StoreOpener-da4e4d853fcab29265a5ca41991cbfb7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region da4e4d853fcab29265a5ca41991cbfb7 columnFamilyName f1 2023-02-16 18:01:28,300 DEBUG [StoreOpener-da4e4d853fcab29265a5ca41991cbfb7-1] regionserver.HStore(539): loaded hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33/data/default/testWithMapReduce/da4e4d853fcab29265a5ca41991cbfb7/f1/testWithMapReduce=da4e4d853fcab29265a5ca41991cbfb7-1bd91146f26142cfad10b726e7ea7d30 2023-02-16 18:01:28,300 INFO [StoreOpener-da4e4d853fcab29265a5ca41991cbfb7-1] regionserver.HStore(310): Store=da4e4d853fcab29265a5ca41991cbfb7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:28,300 INFO [StoreOpener-da4e4d853fcab29265a5ca41991cbfb7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region da4e4d853fcab29265a5ca41991cbfb7 2023-02-16 18:01:28,301 DEBUG [StoreOpener-da4e4d853fcab29265a5ca41991cbfb7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33/data/default/testWithMapReduce/da4e4d853fcab29265a5ca41991cbfb7/f2 2023-02-16 18:01:28,301 INFO [StoreOpener-da4e4d853fcab29265a5ca41991cbfb7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region da4e4d853fcab29265a5ca41991cbfb7 columnFamilyName f2 2023-02-16 18:01:28,305 DEBUG [StoreOpener-da4e4d853fcab29265a5ca41991cbfb7-1] regionserver.HStore(539): loaded hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33/data/default/testWithMapReduce/da4e4d853fcab29265a5ca41991cbfb7/f2/testWithMapReduce=da4e4d853fcab29265a5ca41991cbfb7-6f3ae422c9394771b0047f5d8a0f93fa 2023-02-16 18:01:28,305 INFO [StoreOpener-da4e4d853fcab29265a5ca41991cbfb7-1] regionserver.HStore(310): Store=da4e4d853fcab29265a5ca41991cbfb7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:28,306 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:28,306 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened da4e4d853fcab29265a5ca41991cbfb7; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73321430, jitterRate=0.09257444739341736}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:28,306 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for da4e4d853fcab29265a5ca41991cbfb7: 2023-02-16 18:01:28,335 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing da4e4d853fcab29265a5ca41991cbfb7, disabling compactions & flushes 2023-02-16 18:01:28,336 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7. 2023-02-16 18:01:28,336 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7. 2023-02-16 18:01:28,336 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7. after waiting 0 ms 2023-02-16 18:01:28,336 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7. 2023-02-16 18:01:28,337 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676570482095.da4e4d853fcab29265a5ca41991cbfb7. 2023-02-16 18:01:28,337 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for da4e4d853fcab29265a5ca41991cbfb7: 2023-02-16 18:01:28,341 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:28,341 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 18:01:28,342 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:28,344 INFO [StoreOpener-31afd44b71d5642a373135dee5b626ea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 31afd44b71d5642a373135dee5b626ea 2023-02-16 18:01:28,345 DEBUG [StoreOpener-31afd44b71d5642a373135dee5b626ea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33/data/default/testWithMapReduce/31afd44b71d5642a373135dee5b626ea/f1 2023-02-16 18:01:28,345 INFO [StoreOpener-31afd44b71d5642a373135dee5b626ea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 31afd44b71d5642a373135dee5b626ea columnFamilyName f1 2023-02-16 18:01:28,350 DEBUG [StoreOpener-31afd44b71d5642a373135dee5b626ea-1] regionserver.HStore(539): loaded hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33/data/default/testWithMapReduce/31afd44b71d5642a373135dee5b626ea/f1/testWithMapReduce=31afd44b71d5642a373135dee5b626ea-f4a04c12fd7240f89fb2fbfbef900f63 2023-02-16 18:01:28,351 INFO [StoreOpener-31afd44b71d5642a373135dee5b626ea-1] regionserver.HStore(310): Store=31afd44b71d5642a373135dee5b626ea/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:28,351 INFO [StoreOpener-31afd44b71d5642a373135dee5b626ea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 31afd44b71d5642a373135dee5b626ea 2023-02-16 18:01:28,351 DEBUG [StoreOpener-31afd44b71d5642a373135dee5b626ea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33/data/default/testWithMapReduce/31afd44b71d5642a373135dee5b626ea/f2 2023-02-16 18:01:28,352 INFO [StoreOpener-31afd44b71d5642a373135dee5b626ea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 31afd44b71d5642a373135dee5b626ea columnFamilyName f2 2023-02-16 18:01:28,356 DEBUG [StoreOpener-31afd44b71d5642a373135dee5b626ea-1] regionserver.HStore(539): loaded hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33/data/default/testWithMapReduce/31afd44b71d5642a373135dee5b626ea/f2/testWithMapReduce=31afd44b71d5642a373135dee5b626ea-c42b33ed15a6458abd71bde06f429dcd 2023-02-16 18:01:28,357 INFO [StoreOpener-31afd44b71d5642a373135dee5b626ea-1] regionserver.HStore(310): Store=31afd44b71d5642a373135dee5b626ea/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:28,357 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:28,357 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 31afd44b71d5642a373135dee5b626ea; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72756627, jitterRate=0.08415822684764862}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:28,357 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 31afd44b71d5642a373135dee5b626ea: 2023-02-16 18:01:28,395 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 31afd44b71d5642a373135dee5b626ea, disabling compactions & flushes 2023-02-16 18:01:28,395 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea. 2023-02-16 18:01:28,395 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea. 2023-02-16 18:01:28,395 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea. after waiting 0 ms 2023-02-16 18:01:28,395 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea. 2023-02-16 18:01:28,396 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676570482095.31afd44b71d5642a373135dee5b626ea. 2023-02-16 18:01:28,396 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 31afd44b71d5642a373135dee5b626ea: 2023-02-16 18:01:28,399 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676570482095.d429632777f89bb78e78ce013de08e64.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:28,399 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 18:01:28,400 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:28,402 INFO [StoreOpener-d429632777f89bb78e78ce013de08e64-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d429632777f89bb78e78ce013de08e64 2023-02-16 18:01:28,403 DEBUG [StoreOpener-d429632777f89bb78e78ce013de08e64-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33/data/default/testWithMapReduce/d429632777f89bb78e78ce013de08e64/f1 2023-02-16 18:01:28,403 INFO [StoreOpener-d429632777f89bb78e78ce013de08e64-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d429632777f89bb78e78ce013de08e64 columnFamilyName f1 2023-02-16 18:01:28,407 DEBUG [StoreOpener-d429632777f89bb78e78ce013de08e64-1] regionserver.HStore(539): loaded hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33/data/default/testWithMapReduce/d429632777f89bb78e78ce013de08e64/f1/testWithMapReduce=d429632777f89bb78e78ce013de08e64-e3929f2f85dc4537b631ec7078523243 2023-02-16 18:01:28,407 INFO [StoreOpener-d429632777f89bb78e78ce013de08e64-1] regionserver.HStore(310): Store=d429632777f89bb78e78ce013de08e64/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:28,407 INFO [StoreOpener-d429632777f89bb78e78ce013de08e64-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d429632777f89bb78e78ce013de08e64 2023-02-16 18:01:28,408 DEBUG [StoreOpener-d429632777f89bb78e78ce013de08e64-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33/data/default/testWithMapReduce/d429632777f89bb78e78ce013de08e64/f2 2023-02-16 18:01:28,408 INFO [StoreOpener-d429632777f89bb78e78ce013de08e64-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d429632777f89bb78e78ce013de08e64 columnFamilyName f2 2023-02-16 18:01:28,413 DEBUG [StoreOpener-d429632777f89bb78e78ce013de08e64-1] regionserver.HStore(539): loaded hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33/data/default/testWithMapReduce/d429632777f89bb78e78ce013de08e64/f2/testWithMapReduce=d429632777f89bb78e78ce013de08e64-675e72cb4e724f8ba7b118ee3b6e0b59 2023-02-16 18:01:28,413 INFO [StoreOpener-d429632777f89bb78e78ce013de08e64-1] regionserver.HStore(310): Store=d429632777f89bb78e78ce013de08e64/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:28,413 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:28,413 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened d429632777f89bb78e78ce013de08e64; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64535748, jitterRate=-0.038342416286468506}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:28,413 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for d429632777f89bb78e78ce013de08e64: 2023-02-16 18:01:28,440 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing d429632777f89bb78e78ce013de08e64, disabling compactions & flushes 2023-02-16 18:01:28,440 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676570482095.d429632777f89bb78e78ce013de08e64. 2023-02-16 18:01:28,440 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676570482095.d429632777f89bb78e78ce013de08e64. 2023-02-16 18:01:28,440 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676570482095.d429632777f89bb78e78ce013de08e64. after waiting 0 ms 2023-02-16 18:01:28,440 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676570482095.d429632777f89bb78e78ce013de08e64. 2023-02-16 18:01:28,441 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676570482095.d429632777f89bb78e78ce013de08e64. 2023-02-16 18:01:28,441 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for d429632777f89bb78e78ce013de08e64: 2023-02-16 18:01:28,444 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:28,444 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 18:01:28,446 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:28,447 INFO [StoreOpener-8fdec3876078f55081787f24f961828a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8fdec3876078f55081787f24f961828a 2023-02-16 18:01:28,448 DEBUG [StoreOpener-8fdec3876078f55081787f24f961828a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33/data/default/testWithMapReduce/8fdec3876078f55081787f24f961828a/f1 2023-02-16 18:01:28,449 INFO [StoreOpener-8fdec3876078f55081787f24f961828a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8fdec3876078f55081787f24f961828a columnFamilyName f1 2023-02-16 18:01:28,453 DEBUG [StoreOpener-8fdec3876078f55081787f24f961828a-1] regionserver.HStore(539): loaded hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33/data/default/testWithMapReduce/8fdec3876078f55081787f24f961828a/f1/testWithMapReduce=8fdec3876078f55081787f24f961828a-8e8c6673b85b4b3f86bd4b6f1f1b22b4 2023-02-16 18:01:28,453 INFO [StoreOpener-8fdec3876078f55081787f24f961828a-1] regionserver.HStore(310): Store=8fdec3876078f55081787f24f961828a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:28,453 INFO [StoreOpener-8fdec3876078f55081787f24f961828a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8fdec3876078f55081787f24f961828a 2023-02-16 18:01:28,454 DEBUG [StoreOpener-8fdec3876078f55081787f24f961828a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33/data/default/testWithMapReduce/8fdec3876078f55081787f24f961828a/f2 2023-02-16 18:01:28,455 INFO [StoreOpener-8fdec3876078f55081787f24f961828a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8fdec3876078f55081787f24f961828a columnFamilyName f2 2023-02-16 18:01:28,459 DEBUG [StoreOpener-8fdec3876078f55081787f24f961828a-1] regionserver.HStore(539): loaded hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33/data/default/testWithMapReduce/8fdec3876078f55081787f24f961828a/f2/testWithMapReduce=8fdec3876078f55081787f24f961828a-7bd5b25253694d24863e2c1c9e799146 2023-02-16 18:01:28,459 INFO [StoreOpener-8fdec3876078f55081787f24f961828a-1] regionserver.HStore(310): Store=8fdec3876078f55081787f24f961828a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:28,459 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:28,459 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 8fdec3876078f55081787f24f961828a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63744385, jitterRate=-0.05013464391231537}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:28,459 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 8fdec3876078f55081787f24f961828a: 2023-02-16 18:01:28,487 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 8fdec3876078f55081787f24f961828a, disabling compactions & flushes 2023-02-16 18:01:28,487 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a. 2023-02-16 18:01:28,487 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a. 2023-02-16 18:01:28,487 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a. after waiting 0 ms 2023-02-16 18:01:28,487 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a. 2023-02-16 18:01:28,488 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676570482095.8fdec3876078f55081787f24f961828a. 2023-02-16 18:01:28,488 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 8fdec3876078f55081787f24f961828a: 2023-02-16 18:01:28,491 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676570482095.eb6d74bacfba537526abbce930880639.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:28,491 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 18:01:28,493 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:28,495 INFO [StoreOpener-eb6d74bacfba537526abbce930880639-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region eb6d74bacfba537526abbce930880639 2023-02-16 18:01:28,496 DEBUG [StoreOpener-eb6d74bacfba537526abbce930880639-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33/data/default/testWithMapReduce/eb6d74bacfba537526abbce930880639/f1 2023-02-16 18:01:28,496 INFO [StoreOpener-eb6d74bacfba537526abbce930880639-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eb6d74bacfba537526abbce930880639 columnFamilyName f1 2023-02-16 18:01:28,500 DEBUG [StoreOpener-eb6d74bacfba537526abbce930880639-1] regionserver.HStore(539): loaded hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33/data/default/testWithMapReduce/eb6d74bacfba537526abbce930880639/f1/testWithMapReduce=eb6d74bacfba537526abbce930880639-6c913cd5d86a4f12a25a07bc0db3c3d0 2023-02-16 18:01:28,500 INFO [StoreOpener-eb6d74bacfba537526abbce930880639-1] regionserver.HStore(310): Store=eb6d74bacfba537526abbce930880639/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:28,501 INFO [StoreOpener-eb6d74bacfba537526abbce930880639-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region eb6d74bacfba537526abbce930880639 2023-02-16 18:01:28,501 DEBUG [StoreOpener-eb6d74bacfba537526abbce930880639-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33/data/default/testWithMapReduce/eb6d74bacfba537526abbce930880639/f2 2023-02-16 18:01:28,502 INFO [StoreOpener-eb6d74bacfba537526abbce930880639-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eb6d74bacfba537526abbce930880639 columnFamilyName f2 2023-02-16 18:01:28,505 DEBUG [StoreOpener-eb6d74bacfba537526abbce930880639-1] regionserver.HStore(539): loaded hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33/data/default/testWithMapReduce/eb6d74bacfba537526abbce930880639/f2/testWithMapReduce=eb6d74bacfba537526abbce930880639-d3aa4d87925e494c881d5479ae7d79c1 2023-02-16 18:01:28,506 INFO [StoreOpener-eb6d74bacfba537526abbce930880639-1] regionserver.HStore(310): Store=eb6d74bacfba537526abbce930880639/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:28,506 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:28,506 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened eb6d74bacfba537526abbce930880639; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65660474, jitterRate=-0.021582692861557007}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:28,506 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for eb6d74bacfba537526abbce930880639: 2023-02-16 18:01:28,533 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing eb6d74bacfba537526abbce930880639, disabling compactions & flushes 2023-02-16 18:01:28,533 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676570482095.eb6d74bacfba537526abbce930880639. 2023-02-16 18:01:28,533 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676570482095.eb6d74bacfba537526abbce930880639. 2023-02-16 18:01:28,533 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676570482095.eb6d74bacfba537526abbce930880639. after waiting 0 ms 2023-02-16 18:01:28,533 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676570482095.eb6d74bacfba537526abbce930880639. 2023-02-16 18:01:28,534 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676570482095.eb6d74bacfba537526abbce930880639. 2023-02-16 18:01:28,534 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for eb6d74bacfba537526abbce930880639: 2023-02-16 18:01:28,536 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:28,536 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 18:01:28,537 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:28,539 INFO [StoreOpener-ff112adcde372b676d79e75223744fae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ff112adcde372b676d79e75223744fae 2023-02-16 18:01:28,540 DEBUG [StoreOpener-ff112adcde372b676d79e75223744fae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33/data/default/testWithMapReduce/ff112adcde372b676d79e75223744fae/f1 2023-02-16 18:01:28,540 INFO [StoreOpener-ff112adcde372b676d79e75223744fae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff112adcde372b676d79e75223744fae columnFamilyName f1 2023-02-16 18:01:28,544 DEBUG [StoreOpener-ff112adcde372b676d79e75223744fae-1] regionserver.HStore(539): loaded hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33/data/default/testWithMapReduce/ff112adcde372b676d79e75223744fae/f1/testWithMapReduce=ff112adcde372b676d79e75223744fae-801563733c2f41b2846d6530c3d87ad9 2023-02-16 18:01:28,544 INFO [StoreOpener-ff112adcde372b676d79e75223744fae-1] regionserver.HStore(310): Store=ff112adcde372b676d79e75223744fae/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:28,544 INFO [StoreOpener-ff112adcde372b676d79e75223744fae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ff112adcde372b676d79e75223744fae 2023-02-16 18:01:28,545 DEBUG [StoreOpener-ff112adcde372b676d79e75223744fae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33/data/default/testWithMapReduce/ff112adcde372b676d79e75223744fae/f2 2023-02-16 18:01:28,545 INFO [StoreOpener-ff112adcde372b676d79e75223744fae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff112adcde372b676d79e75223744fae columnFamilyName f2 2023-02-16 18:01:28,550 DEBUG [StoreOpener-ff112adcde372b676d79e75223744fae-1] regionserver.HStore(539): loaded hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33/data/default/testWithMapReduce/ff112adcde372b676d79e75223744fae/f2/testWithMapReduce=ff112adcde372b676d79e75223744fae-791df0b395a24ce3bd1323aadd628fa6 2023-02-16 18:01:28,550 INFO [StoreOpener-ff112adcde372b676d79e75223744fae-1] regionserver.HStore(310): Store=ff112adcde372b676d79e75223744fae/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:28,550 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:28,550 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened ff112adcde372b676d79e75223744fae; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70238897, jitterRate=0.04664112627506256}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:28,550 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for ff112adcde372b676d79e75223744fae: 2023-02-16 18:01:28,577 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing ff112adcde372b676d79e75223744fae, disabling compactions & flushes 2023-02-16 18:01:28,577 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae. 2023-02-16 18:01:28,577 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae. 2023-02-16 18:01:28,577 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae. after waiting 0 ms 2023-02-16 18:01:28,577 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae. 2023-02-16 18:01:28,578 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676570482095.ff112adcde372b676d79e75223744fae. 2023-02-16 18:01:28,578 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for ff112adcde372b676d79e75223744fae: 2023-02-16 18:01:28,582 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:28,582 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 18:01:28,583 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:28,585 INFO [StoreOpener-f6fea7abf2b32dbe67a267c0cf01e593-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f6fea7abf2b32dbe67a267c0cf01e593 2023-02-16 18:01:28,586 DEBUG [StoreOpener-f6fea7abf2b32dbe67a267c0cf01e593-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33/data/default/testWithMapReduce/f6fea7abf2b32dbe67a267c0cf01e593/f1 2023-02-16 18:01:28,586 INFO [StoreOpener-f6fea7abf2b32dbe67a267c0cf01e593-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f6fea7abf2b32dbe67a267c0cf01e593 columnFamilyName f1 2023-02-16 18:01:28,587 INFO [StoreOpener-f6fea7abf2b32dbe67a267c0cf01e593-1] regionserver.HStore(310): Store=f6fea7abf2b32dbe67a267c0cf01e593/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:28,587 INFO [StoreOpener-f6fea7abf2b32dbe67a267c0cf01e593-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f6fea7abf2b32dbe67a267c0cf01e593 2023-02-16 18:01:28,588 DEBUG [StoreOpener-f6fea7abf2b32dbe67a267c0cf01e593-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33/data/default/testWithMapReduce/f6fea7abf2b32dbe67a267c0cf01e593/f2 2023-02-16 18:01:28,588 INFO [StoreOpener-f6fea7abf2b32dbe67a267c0cf01e593-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f6fea7abf2b32dbe67a267c0cf01e593 columnFamilyName f2 2023-02-16 18:01:28,589 INFO [StoreOpener-f6fea7abf2b32dbe67a267c0cf01e593-1] regionserver.HStore(310): Store=f6fea7abf2b32dbe67a267c0cf01e593/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:28,589 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:28,589 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened f6fea7abf2b32dbe67a267c0cf01e593; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67203690, jitterRate=0.0014130175113677979}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:28,589 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for f6fea7abf2b32dbe67a267c0cf01e593: 2023-02-16 18:01:28,612 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing f6fea7abf2b32dbe67a267c0cf01e593, disabling compactions & flushes 2023-02-16 18:01:28,612 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593. 2023-02-16 18:01:28,612 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593. 2023-02-16 18:01:28,612 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593. after waiting 0 ms 2023-02-16 18:01:28,612 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593. 2023-02-16 18:01:28,612 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676570482095.f6fea7abf2b32dbe67a267c0cf01e593. 2023-02-16 18:01:28,613 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for f6fea7abf2b32dbe67a267c0cf01e593: 2023-02-16 18:01:28,615 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:28,615 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 18:01:28,616 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:28,618 INFO [StoreOpener-e155df5ccc3da2f833eca9746ce9ba33-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e155df5ccc3da2f833eca9746ce9ba33 2023-02-16 18:01:28,620 DEBUG [StoreOpener-e155df5ccc3da2f833eca9746ce9ba33-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33/data/default/testWithMapReduce/e155df5ccc3da2f833eca9746ce9ba33/f1 2023-02-16 18:01:28,620 INFO [StoreOpener-e155df5ccc3da2f833eca9746ce9ba33-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e155df5ccc3da2f833eca9746ce9ba33 columnFamilyName f1 2023-02-16 18:01:28,620 INFO [StoreOpener-e155df5ccc3da2f833eca9746ce9ba33-1] regionserver.HStore(310): Store=e155df5ccc3da2f833eca9746ce9ba33/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:28,621 INFO [StoreOpener-e155df5ccc3da2f833eca9746ce9ba33-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e155df5ccc3da2f833eca9746ce9ba33 2023-02-16 18:01:28,622 DEBUG [StoreOpener-e155df5ccc3da2f833eca9746ce9ba33-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43277/user/jenkins/test-data/86e48e13-7ab9-acf4-3fcd-8dd225b18020/testWithMapReduceAndOfflineHBaseMultiRegion/98555b68-24f8-452c-b94f-b5d78eb2ee33/data/default/testWithMapReduce/e155df5ccc3da2f833eca9746ce9ba33/f2 2023-02-16 18:01:28,622 INFO [StoreOpener-e155df5ccc3da2f833eca9746ce9ba33-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e155df5ccc3da2f833eca9746ce9ba33 columnFamilyName f2 2023-02-16 18:01:28,623 INFO [StoreOpener-e155df5ccc3da2f833eca9746ce9ba33-1] regionserver.HStore(310): Store=e155df5ccc3da2f833eca9746ce9ba33/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:28,623 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:28,623 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e155df5ccc3da2f833eca9746ce9ba33; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69258002, jitterRate=0.032024651765823364}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:28,623 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e155df5ccc3da2f833eca9746ce9ba33: 2023-02-16 18:01:28,641 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e155df5ccc3da2f833eca9746ce9ba33, disabling compactions & flushes 2023-02-16 18:01:28,642 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33. 2023-02-16 18:01:28,642 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33. 2023-02-16 18:01:28,642 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33. after waiting 0 ms 2023-02-16 18:01:28,642 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33. 2023-02-16 18:01:28,642 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676570482095.e155df5ccc3da2f833eca9746ce9ba33. 2023-02-16 18:01:28,642 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e155df5ccc3da2f833eca9746ce9ba33: 2023-02-16 18:01:28,809 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-16 18:01:29,184 INFO [Listener at localhost/46409] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-16 18:01:29,184 WARN [Listener at localhost/46409] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 18:01:29,187 INFO [Listener at localhost/46409] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 18:01:29,291 WARN [BP-556202671-172.31.14.131-1676570480031 heartbeating to localhost/127.0.0.1:43277] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 18:01:29,291 WARN [BP-556202671-172.31.14.131-1676570480031 heartbeating to localhost/127.0.0.1:43277] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-556202671-172.31.14.131-1676570480031 (Datanode Uuid 19ace344-c048-460c-9dfe-925e16d36b0e) service to localhost/127.0.0.1:43277 2023-02-16 18:01:29,292 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d/cluster_f15da503-3baf-0635-9396-1501f199f1c3/dfs/data/data3/current/BP-556202671-172.31.14.131-1676570480031] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 18:01:29,292 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d/cluster_f15da503-3baf-0635-9396-1501f199f1c3/dfs/data/data4/current/BP-556202671-172.31.14.131-1676570480031] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 18:01:29,294 WARN [Listener at localhost/46409] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 18:01:29,296 INFO [Listener at localhost/46409] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 18:01:29,401 WARN [BP-556202671-172.31.14.131-1676570480031 heartbeating to localhost/127.0.0.1:43277] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 18:01:29,401 WARN [BP-556202671-172.31.14.131-1676570480031 heartbeating to localhost/127.0.0.1:43277] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-556202671-172.31.14.131-1676570480031 (Datanode Uuid cc29d214-4123-4768-b12d-c938831425e8) service to localhost/127.0.0.1:43277 2023-02-16 18:01:29,401 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d/cluster_f15da503-3baf-0635-9396-1501f199f1c3/dfs/data/data1/current/BP-556202671-172.31.14.131-1676570480031] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 18:01:29,402 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d/cluster_f15da503-3baf-0635-9396-1501f199f1c3/dfs/data/data2/current/BP-556202671-172.31.14.131-1676570480031] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 18:01:29,414 INFO [Listener at localhost/46409] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 18:01:29,534 INFO [Listener at localhost/46409] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-16 18:01:29,580 INFO [Listener at localhost/46409] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-16 18:01:29,594 INFO [Listener at localhost/46409] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=154 (was 103) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,45927,1676570480648)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1124632911) connection to localhost/127.0.0.1:43277 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1124632911) connection to localhost/127.0.0.1:43277 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ForkJoinPool-2-worker-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/46409 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost:43277 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1124632911) connection to localhost/127.0.0.1:43277 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:43277 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost:43277 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1124632911) connection to localhost/127.0.0.1:43277 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=537 (was 541), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=313 (was 299) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=1442 (was 2063) 2023-02-16 18:01:29,606 INFO [Listener at localhost/46409] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=154, OpenFileDescriptor=537, MaxFileDescriptor=60000, SystemLoadAverage=313, ProcessCount=170, AvailableMemoryMB=1441 2023-02-16 18:01:29,618 INFO [Listener at localhost/46409] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d/hadoop.log.dir so I do NOT create it in target/test-data/ddc7f974-af72-3876-7395-ffee8c477e01 2023-02-16 18:01:29,618 WARN [Listener at localhost/46409] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d/hadoop.log.dir Erasing configuration value by system value. 2023-02-16 18:01:29,618 INFO [Listener at localhost/46409] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d/hadoop.tmp.dir so I do NOT create it in target/test-data/ddc7f974-af72-3876-7395-ffee8c477e01 2023-02-16 18:01:29,618 WARN [Listener at localhost/46409] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20c42912-f146-1c72-b35a-13c295d65c1d/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-16 18:01:29,618 DEBUG [Listener at localhost/46409] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddc7f974-af72-3876-7395-ffee8c477e01 2023-02-16 18:01:29,618 INFO [Listener at localhost/46409] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-16 18:01:29,618 INFO [Listener at localhost/46409] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddc7f974-af72-3876-7395-ffee8c477e01/cluster_b24ec5f3-ba47-8918-9587-2d9c9116d949, deleteOnExit=true 2023-02-16 18:01:29,618 INFO [Listener at localhost/46409] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-16 18:01:29,619 INFO [Listener at localhost/46409] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddc7f974-af72-3876-7395-ffee8c477e01/test.cache.data in system properties and HBase conf 2023-02-16 18:01:29,619 INFO [Listener at localhost/46409] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddc7f974-af72-3876-7395-ffee8c477e01/hadoop.tmp.dir in system properties and HBase conf 2023-02-16 18:01:29,619 INFO [Listener at localhost/46409] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddc7f974-af72-3876-7395-ffee8c477e01/hadoop.log.dir in system properties and HBase conf 2023-02-16 18:01:29,619 INFO [Listener at localhost/46409] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddc7f974-af72-3876-7395-ffee8c477e01/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-16 18:01:29,619 INFO [Listener at localhost/46409] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddc7f974-af72-3876-7395-ffee8c477e01/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-16 18:01:29,619 INFO [Listener at localhost/46409] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-16 18:01:29,619 DEBUG [Listener at localhost/46409] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-16 18:01:29,619 INFO [Listener at localhost/46409] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddc7f974-af72-3876-7395-ffee8c477e01/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-16 18:01:29,620 INFO [Listener at localhost/46409] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddc7f974-af72-3876-7395-ffee8c477e01/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-16 18:01:29,620 INFO [Listener at localhost/46409] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddc7f974-af72-3876-7395-ffee8c477e01/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-16 18:01:29,620 INFO [Listener at localhost/46409] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddc7f974-af72-3876-7395-ffee8c477e01/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 18:01:29,620 INFO [Listener at localhost/46409] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddc7f974-af72-3876-7395-ffee8c477e01/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-16 18:01:29,620 INFO [Listener at localhost/46409] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddc7f974-af72-3876-7395-ffee8c477e01/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-16 18:01:29,620 INFO [Listener at localhost/46409] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddc7f974-af72-3876-7395-ffee8c477e01/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 18:01:29,620 INFO [Listener at localhost/46409] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddc7f974-af72-3876-7395-ffee8c477e01/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 18:01:29,620 INFO [Listener at localhost/46409] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddc7f974-af72-3876-7395-ffee8c477e01/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-16 18:01:29,620 INFO [Listener at localhost/46409] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddc7f974-af72-3876-7395-ffee8c477e01/nfs.dump.dir in system properties and HBase conf 2023-02-16 18:01:29,621 INFO [Listener at localhost/46409] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddc7f974-af72-3876-7395-ffee8c477e01/java.io.tmpdir in system properties and HBase conf 2023-02-16 18:01:29,621 INFO [Listener at localhost/46409] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddc7f974-af72-3876-7395-ffee8c477e01/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 18:01:29,621 INFO [Listener at localhost/46409] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddc7f974-af72-3876-7395-ffee8c477e01/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-16 18:01:29,621 INFO [Listener at localhost/46409] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddc7f974-af72-3876-7395-ffee8c477e01/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-16 18:01:29,625 WARN [Listener at localhost/46409] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 18:01:29,626 WARN [Listener at localhost/46409] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 18:01:29,667 WARN [Listener at localhost/46409] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 18:01:29,669 INFO [Listener at localhost/46409] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 18:01:29,674 INFO [Listener at localhost/46409] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddc7f974-af72-3876-7395-ffee8c477e01/java.io.tmpdir/Jetty_localhost_37805_hdfs____waqupv/webapp 2023-02-16 18:01:29,771 INFO [Listener at localhost/46409] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37805 2023-02-16 18:01:29,775 WARN [Listener at localhost/46409] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 18:01:29,775 WARN [Listener at localhost/46409] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 18:01:29,813 WARN [Listener at localhost/42551] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 18:01:29,822 WARN [Listener at localhost/42551] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 18:01:29,824 WARN [Listener at localhost/42551] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 18:01:29,825 INFO [Listener at localhost/42551] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 18:01:29,829 INFO [Listener at localhost/42551] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddc7f974-af72-3876-7395-ffee8c477e01/java.io.tmpdir/Jetty_localhost_39245_datanode____.m1idn0/webapp 2023-02-16 18:01:29,922 INFO [Listener at localhost/42551] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39245 2023-02-16 18:01:29,929 WARN [Listener at localhost/46741] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 18:01:29,941 WARN [Listener at localhost/46741] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 18:01:29,944 WARN [Listener at localhost/46741] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 18:01:29,945 INFO [Listener at localhost/46741] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 18:01:29,947 INFO [Listener at localhost/46741] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddc7f974-af72-3876-7395-ffee8c477e01/java.io.tmpdir/Jetty_localhost_38795_datanode____.1ruyh7/webapp 2023-02-16 18:01:30,033 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe8e9bc751dac2ca7: Processing first storage report for DS-3cbb9df7-7a43-4b1f-8358-3f7ffcc89b39 from datanode 3581c93b-0176-4c27-980d-97d274d7d984 2023-02-16 18:01:30,033 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe8e9bc751dac2ca7: from storage DS-3cbb9df7-7a43-4b1f-8358-3f7ffcc89b39 node DatanodeRegistration(127.0.0.1:35909, datanodeUuid=3581c93b-0176-4c27-980d-97d274d7d984, infoPort=44347, infoSecurePort=0, ipcPort=46741, storageInfo=lv=-57;cid=testClusterID;nsid=1376090599;c=1676570489629), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 18:01:30,033 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe8e9bc751dac2ca7: Processing first storage report for DS-9bccdcb4-4617-4500-a31c-bc32bdc58b1c from datanode 3581c93b-0176-4c27-980d-97d274d7d984 2023-02-16 18:01:30,033 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe8e9bc751dac2ca7: from storage DS-9bccdcb4-4617-4500-a31c-bc32bdc58b1c node DatanodeRegistration(127.0.0.1:35909, datanodeUuid=3581c93b-0176-4c27-980d-97d274d7d984, infoPort=44347, infoSecurePort=0, ipcPort=46741, storageInfo=lv=-57;cid=testClusterID;nsid=1376090599;c=1676570489629), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 18:01:30,057 INFO [Listener at localhost/46741] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38795 2023-02-16 18:01:30,064 WARN [Listener at localhost/39309] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 18:01:30,152 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcca3b1dc9e688387: Processing first storage report for DS-620c4cd2-7bd3-434c-b4ae-3984658dcbc5 from datanode 0f517380-fc7a-477e-9940-5e583b596645 2023-02-16 18:01:30,152 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcca3b1dc9e688387: from storage DS-620c4cd2-7bd3-434c-b4ae-3984658dcbc5 node DatanodeRegistration(127.0.0.1:33709, datanodeUuid=0f517380-fc7a-477e-9940-5e583b596645, infoPort=36631, infoSecurePort=0, ipcPort=39309, storageInfo=lv=-57;cid=testClusterID;nsid=1376090599;c=1676570489629), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 18:01:30,152 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcca3b1dc9e688387: Processing first storage report for DS-ddaf9b69-b2f4-4137-bada-de4ed269397b from datanode 0f517380-fc7a-477e-9940-5e583b596645 2023-02-16 18:01:30,152 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcca3b1dc9e688387: from storage DS-ddaf9b69-b2f4-4137-bada-de4ed269397b node DatanodeRegistration(127.0.0.1:33709, datanodeUuid=0f517380-fc7a-477e-9940-5e583b596645, infoPort=36631, infoSecurePort=0, ipcPort=39309, storageInfo=lv=-57;cid=testClusterID;nsid=1376090599;c=1676570489629), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 18:01:30,171 DEBUG [Listener at localhost/39309] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddc7f974-af72-3876-7395-ffee8c477e01 2023-02-16 18:01:30,173 INFO [Listener at localhost/39309] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddc7f974-af72-3876-7395-ffee8c477e01/cluster_b24ec5f3-ba47-8918-9587-2d9c9116d949/zookeeper_0, clientPort=50324, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddc7f974-af72-3876-7395-ffee8c477e01/cluster_b24ec5f3-ba47-8918-9587-2d9c9116d949/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddc7f974-af72-3876-7395-ffee8c477e01/cluster_b24ec5f3-ba47-8918-9587-2d9c9116d949/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-16 18:01:30,174 INFO [Listener at localhost/39309] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=50324 2023-02-16 18:01:30,174 INFO [Listener at localhost/39309] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:30,175 INFO [Listener at localhost/39309] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:30,187 INFO [Listener at localhost/39309] util.FSUtils(479): Created version file at hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc with version=8 2023-02-16 18:01:30,187 INFO [Listener at localhost/39309] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:30,188 INFO [Listener at localhost/39309] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:30,189 INFO [Listener at localhost/39309] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:42551/user/jenkins/test-data/9e945780-56f7-6df0-3aa5-9060846ea363/hbase-staging 2023-02-16 18:01:30,191 INFO [Listener at localhost/39309] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 18:01:30,191 INFO [Listener at localhost/39309] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:30,191 INFO [Listener at localhost/39309] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:30,191 INFO [Listener at localhost/39309] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 18:01:30,191 INFO [Listener at localhost/39309] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:30,191 INFO [Listener at localhost/39309] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 18:01:30,191 INFO [Listener at localhost/39309] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 18:01:30,192 INFO [Listener at localhost/39309] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37139 2023-02-16 18:01:30,193 INFO [Listener at localhost/39309] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:30,193 INFO [Listener at localhost/39309] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:30,194 INFO [Listener at localhost/39309] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37139 connecting to ZooKeeper ensemble=127.0.0.1:50324 2023-02-16 18:01:30,203 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:371390x0, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 18:01:30,204 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:37139-0x1005e4b5f010000 connected 2023-02-16 18:01:30,217 DEBUG [Listener at localhost/39309] zookeeper.ZKUtil(164): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 18:01:30,217 DEBUG [Listener at localhost/39309] zookeeper.ZKUtil(164): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:30,218 DEBUG [Listener at localhost/39309] zookeeper.ZKUtil(164): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 18:01:30,218 DEBUG [Listener at localhost/39309] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37139 2023-02-16 18:01:30,218 DEBUG [Listener at localhost/39309] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37139 2023-02-16 18:01:30,219 DEBUG [Listener at localhost/39309] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37139 2023-02-16 18:01:30,219 DEBUG [Listener at localhost/39309] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37139 2023-02-16 18:01:30,219 DEBUG [Listener at localhost/39309] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37139 2023-02-16 18:01:30,220 INFO [Listener at localhost/39309] master.HMaster(444): hbase.rootdir=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc, hbase.cluster.distributed=false 2023-02-16 18:01:30,235 INFO [Listener at localhost/39309] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 18:01:30,235 INFO [Listener at localhost/39309] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:30,235 INFO [Listener at localhost/39309] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:30,235 INFO [Listener at localhost/39309] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 18:01:30,235 INFO [Listener at localhost/39309] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:30,235 INFO [Listener at localhost/39309] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 18:01:30,236 INFO [Listener at localhost/39309] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 18:01:30,238 INFO [Listener at localhost/39309] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35157 2023-02-16 18:01:30,238 INFO [Listener at localhost/39309] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 18:01:30,239 DEBUG [Listener at localhost/39309] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:30,240 INFO [Listener at localhost/39309] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:30,241 INFO [Listener at localhost/39309] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:30,242 INFO [Listener at localhost/39309] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35157 connecting to ZooKeeper ensemble=127.0.0.1:50324 2023-02-16 18:01:30,249 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:351570x0, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 18:01:30,251 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:35157-0x1005e4b5f010001 connected 2023-02-16 18:01:30,252 DEBUG [Listener at localhost/39309] zookeeper.ZKUtil(164): regionserver:35157-0x1005e4b5f010001, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 18:01:30,252 DEBUG [Listener at localhost/39309] zookeeper.ZKUtil(164): regionserver:35157-0x1005e4b5f010001, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:30,253 DEBUG [Listener at localhost/39309] zookeeper.ZKUtil(164): regionserver:35157-0x1005e4b5f010001, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 18:01:30,261 DEBUG [Listener at localhost/39309] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35157 2023-02-16 18:01:30,262 DEBUG [Listener at localhost/39309] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35157 2023-02-16 18:01:30,262 DEBUG [Listener at localhost/39309] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35157 2023-02-16 18:01:30,272 DEBUG [Listener at localhost/39309] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35157 2023-02-16 18:01:30,276 DEBUG [Listener at localhost/39309] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35157 2023-02-16 18:01:30,294 INFO [Listener at localhost/39309] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 18:01:30,294 INFO [Listener at localhost/39309] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:30,294 INFO [Listener at localhost/39309] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:30,294 INFO [Listener at localhost/39309] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 18:01:30,294 INFO [Listener at localhost/39309] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:30,294 INFO [Listener at localhost/39309] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 18:01:30,294 INFO [Listener at localhost/39309] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 18:01:30,299 INFO [Listener at localhost/39309] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38535 2023-02-16 18:01:30,299 INFO [Listener at localhost/39309] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 18:01:30,304 DEBUG [Listener at localhost/39309] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:30,305 INFO [Listener at localhost/39309] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:30,306 INFO [Listener at localhost/39309] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:30,307 INFO [Listener at localhost/39309] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38535 connecting to ZooKeeper ensemble=127.0.0.1:50324 2023-02-16 18:01:30,324 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:385350x0, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 18:01:30,326 DEBUG [Listener at localhost/39309] zookeeper.ZKUtil(164): regionserver:385350x0, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 18:01:30,327 DEBUG [Listener at localhost/39309] zookeeper.ZKUtil(164): regionserver:385350x0, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:30,329 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38535-0x1005e4b5f010002 connected 2023-02-16 18:01:30,329 DEBUG [Listener at localhost/39309] zookeeper.ZKUtil(164): regionserver:38535-0x1005e4b5f010002, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 18:01:30,333 DEBUG [Listener at localhost/39309] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38535 2023-02-16 18:01:30,333 DEBUG [Listener at localhost/39309] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38535 2023-02-16 18:01:30,334 DEBUG [Listener at localhost/39309] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38535 2023-02-16 18:01:30,335 DEBUG [Listener at localhost/39309] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38535 2023-02-16 18:01:30,336 DEBUG [Listener at localhost/39309] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38535 2023-02-16 18:01:30,337 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,37139,1676570490190 2023-02-16 18:01:30,343 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 18:01:30,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,37139,1676570490190 2023-02-16 18:01:30,345 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:38535-0x1005e4b5f010002, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 18:01:30,345 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 18:01:30,345 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:35157-0x1005e4b5f010001, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 18:01:30,346 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:30,347 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 18:01:30,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,37139,1676570490190 from backup master directory 2023-02-16 18:01:30,349 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 18:01:30,350 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,37139,1676570490190 2023-02-16 18:01:30,350 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 18:01:30,350 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 18:01:30,350 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,37139,1676570490190 2023-02-16 18:01:30,364 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/hbase.id with ID: b317b69e-c637-49a1-8062-32daa618c6af 2023-02-16 18:01:30,376 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:30,379 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:30,398 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x3952cd29 to 127.0.0.1:50324 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 18:01:30,405 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@eb95b33, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 18:01:30,405 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 18:01:30,405 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-16 18:01:30,406 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 18:01:30,407 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/MasterData/data/master/store-tmp 2023-02-16 18:01:30,424 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:30,424 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 18:01:30,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:30,425 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:30,425 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 18:01:30,425 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:30,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:30,425 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 18:01:30,426 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/MasterData/WALs/jenkins-hbase4.apache.org,37139,1676570490190 2023-02-16 18:01:30,430 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37139%2C1676570490190, suffix=, logDir=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/MasterData/WALs/jenkins-hbase4.apache.org,37139,1676570490190, archiveDir=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/MasterData/oldWALs, maxLogs=10 2023-02-16 18:01:30,448 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33709,DS-620c4cd2-7bd3-434c-b4ae-3984658dcbc5,DISK] 2023-02-16 18:01:30,448 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35909,DS-3cbb9df7-7a43-4b1f-8358-3f7ffcc89b39,DISK] 2023-02-16 18:01:30,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/MasterData/WALs/jenkins-hbase4.apache.org,37139,1676570490190/jenkins-hbase4.apache.org%2C37139%2C1676570490190.1676570490430 2023-02-16 18:01:30,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33709,DS-620c4cd2-7bd3-434c-b4ae-3984658dcbc5,DISK], DatanodeInfoWithStorage[127.0.0.1:35909,DS-3cbb9df7-7a43-4b1f-8358-3f7ffcc89b39,DISK]] 2023-02-16 18:01:30,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-16 18:01:30,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:30,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:30,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:30,454 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:30,455 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-16 18:01:30,456 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-16 18:01:30,456 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:30,457 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:30,458 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:30,461 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:30,463 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:30,464 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69854893, jitterRate=0.040919020771980286}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 18:01:30,464 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 18:01:30,464 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-16 18:01:30,465 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-16 18:01:30,466 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-16 18:01:30,466 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-16 18:01:30,466 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-16 18:01:30,466 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-16 18:01:30,467 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-16 18:01:30,467 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-16 18:01:30,468 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-16 18:01:30,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-16 18:01:30,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-16 18:01:30,480 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-16 18:01:30,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-16 18:01:30,481 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-16 18:01:30,486 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:30,487 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-16 18:01:30,487 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-16 18:01:30,488 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-16 18:01:30,490 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:38535-0x1005e4b5f010002, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:30,490 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:35157-0x1005e4b5f010001, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:30,490 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:30,490 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:30,490 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,37139,1676570490190, sessionid=0x1005e4b5f010000, setting cluster-up flag (Was=false) 2023-02-16 18:01:30,495 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:30,499 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-16 18:01:30,500 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37139,1676570490190 2023-02-16 18:01:30,502 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:30,507 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-16 18:01:30,507 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37139,1676570490190 2023-02-16 18:01:30,508 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/.hbase-snapshot/.tmp 2023-02-16 18:01:30,510 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-16 18:01:30,510 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 18:01:30,510 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 18:01:30,510 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 18:01:30,510 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 18:01:30,510 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-16 18:01:30,510 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:30,510 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 18:01:30,510 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:30,512 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676570520511 2023-02-16 18:01:30,512 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-16 18:01:30,512 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-16 18:01:30,512 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-16 18:01:30,512 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-16 18:01:30,512 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-16 18:01:30,512 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-16 18:01:30,513 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:30,513 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 18:01:30,513 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-16 18:01:30,513 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-16 18:01:30,513 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-16 18:01:30,513 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-16 18:01:30,514 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-16 18:01:30,514 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-16 18:01:30,514 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676570490514,5,FailOnTimeoutGroup] 2023-02-16 18:01:30,514 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676570490514,5,FailOnTimeoutGroup] 2023-02-16 18:01:30,514 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:30,514 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-16 18:01:30,514 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:30,514 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:30,514 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 18:01:30,538 INFO [RS:1;jenkins-hbase4:38535] regionserver.HRegionServer(952): ClusterId : b317b69e-c637-49a1-8062-32daa618c6af 2023-02-16 18:01:30,539 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 18:01:30,539 INFO [RS:0;jenkins-hbase4:35157] regionserver.HRegionServer(952): ClusterId : b317b69e-c637-49a1-8062-32daa618c6af 2023-02-16 18:01:30,539 DEBUG [RS:1;jenkins-hbase4:38535] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 18:01:30,539 DEBUG [RS:0;jenkins-hbase4:35157] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 18:01:30,539 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 18:01:30,539 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc 2023-02-16 18:01:30,541 DEBUG [RS:0;jenkins-hbase4:35157] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 18:01:30,541 DEBUG [RS:0;jenkins-hbase4:35157] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 18:01:30,541 DEBUG [RS:1;jenkins-hbase4:38535] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 18:01:30,541 DEBUG [RS:1;jenkins-hbase4:38535] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 18:01:30,543 DEBUG [RS:0;jenkins-hbase4:35157] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 18:01:30,544 DEBUG [RS:0;jenkins-hbase4:35157] zookeeper.ReadOnlyZKClient(139): Connect 0x103d4457 to 127.0.0.1:50324 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 18:01:30,544 DEBUG [RS:1;jenkins-hbase4:38535] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 18:01:30,549 DEBUG [RS:1;jenkins-hbase4:38535] zookeeper.ReadOnlyZKClient(139): Connect 0x0eb8d8dc to 127.0.0.1:50324 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 18:01:30,571 DEBUG [RS:0;jenkins-hbase4:35157] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1efaa820, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 18:01:30,572 DEBUG [RS:0;jenkins-hbase4:35157] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ac52f27, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 18:01:30,573 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:30,583 DEBUG [RS:0;jenkins-hbase4:35157] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:35157 2023-02-16 18:01:30,583 INFO [RS:0;jenkins-hbase4:35157] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 18:01:30,583 INFO [RS:0;jenkins-hbase4:35157] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 18:01:30,583 DEBUG [RS:0;jenkins-hbase4:35157] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 18:01:30,584 INFO [RS:0;jenkins-hbase4:35157] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37139,1676570490190 with isa=jenkins-hbase4.apache.org/172.31.14.131:35157, startcode=1676570490234 2023-02-16 18:01:30,584 DEBUG [RS:0;jenkins-hbase4:35157] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 18:01:30,588 DEBUG [RS:1;jenkins-hbase4:38535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f377b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 18:01:30,588 DEBUG [RS:1;jenkins-hbase4:38535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@440b3ac, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 18:01:30,589 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46017, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 18:01:30,592 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 18:01:30,592 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35157,1676570490234 2023-02-16 18:01:30,592 DEBUG [RS:0;jenkins-hbase4:35157] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc 2023-02-16 18:01:30,593 DEBUG [RS:0;jenkins-hbase4:35157] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:42551 2023-02-16 18:01:30,593 DEBUG [RS:0;jenkins-hbase4:35157] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 18:01:30,595 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:30,596 DEBUG [RS:0;jenkins-hbase4:35157] zookeeper.ZKUtil(162): regionserver:35157-0x1005e4b5f010001, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35157,1676570490234 2023-02-16 18:01:30,596 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/hbase/meta/1588230740/info 2023-02-16 18:01:30,596 WARN [RS:0;jenkins-hbase4:35157] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 18:01:30,596 INFO [RS:0;jenkins-hbase4:35157] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 18:01:30,596 DEBUG [RS:0;jenkins-hbase4:35157] regionserver.HRegionServer(1947): logDir=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/WALs/jenkins-hbase4.apache.org,35157,1676570490234 2023-02-16 18:01:30,597 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 18:01:30,597 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35157,1676570490234] 2023-02-16 18:01:30,600 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:30,600 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 18:01:30,605 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/hbase/meta/1588230740/rep_barrier 2023-02-16 18:01:30,606 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 18:01:30,606 DEBUG [RS:0;jenkins-hbase4:35157] zookeeper.ZKUtil(162): regionserver:35157-0x1005e4b5f010001, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35157,1676570490234 2023-02-16 18:01:30,606 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:30,606 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 18:01:30,607 DEBUG [RS:0;jenkins-hbase4:35157] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 18:01:30,607 INFO [RS:0;jenkins-hbase4:35157] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 18:01:30,608 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/hbase/meta/1588230740/table 2023-02-16 18:01:30,608 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 18:01:30,608 DEBUG [RS:1;jenkins-hbase4:38535] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:38535 2023-02-16 18:01:30,608 INFO [RS:1;jenkins-hbase4:38535] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 18:01:30,608 INFO [RS:0;jenkins-hbase4:35157] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 18:01:30,608 INFO [RS:1;jenkins-hbase4:38535] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 18:01:30,609 DEBUG [RS:1;jenkins-hbase4:38535] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 18:01:30,609 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:30,609 INFO [RS:0;jenkins-hbase4:35157] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 18:01:30,609 INFO [RS:0;jenkins-hbase4:35157] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:30,609 INFO [RS:1;jenkins-hbase4:38535] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37139,1676570490190 with isa=jenkins-hbase4.apache.org/172.31.14.131:38535, startcode=1676570490293 2023-02-16 18:01:30,609 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/hbase/meta/1588230740 2023-02-16 18:01:30,609 DEBUG [RS:1;jenkins-hbase4:38535] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 18:01:30,609 INFO [RS:0;jenkins-hbase4:35157] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 18:01:30,610 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/hbase/meta/1588230740 2023-02-16 18:01:30,611 INFO [RS:0;jenkins-hbase4:35157] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:30,611 DEBUG [RS:0;jenkins-hbase4:35157] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:30,611 DEBUG [RS:0;jenkins-hbase4:35157] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:30,612 DEBUG [RS:0;jenkins-hbase4:35157] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:30,612 DEBUG [RS:0;jenkins-hbase4:35157] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:30,612 DEBUG [RS:0;jenkins-hbase4:35157] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:30,612 DEBUG [RS:0;jenkins-hbase4:35157] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 18:01:30,612 DEBUG [RS:0;jenkins-hbase4:35157] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:30,612 DEBUG [RS:0;jenkins-hbase4:35157] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:30,612 DEBUG [RS:0;jenkins-hbase4:35157] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:30,612 DEBUG [RS:0;jenkins-hbase4:35157] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:30,616 INFO [RS:0;jenkins-hbase4:35157] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:30,616 INFO [RS:0;jenkins-hbase4:35157] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:30,616 INFO [RS:0;jenkins-hbase4:35157] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:30,617 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39313, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 18:01:30,617 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 18:01:30,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:30,618 DEBUG [RS:1;jenkins-hbase4:38535] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc 2023-02-16 18:01:30,618 DEBUG [RS:1;jenkins-hbase4:38535] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:42551 2023-02-16 18:01:30,618 DEBUG [RS:1;jenkins-hbase4:38535] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 18:01:30,618 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 18:01:30,622 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:30,622 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:30,622 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:35157-0x1005e4b5f010001, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:30,622 DEBUG [RS:1;jenkins-hbase4:38535] zookeeper.ZKUtil(162): regionserver:38535-0x1005e4b5f010002, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:30,622 WARN [RS:1;jenkins-hbase4:38535] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 18:01:30,622 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38535,1676570490293] 2023-02-16 18:01:30,622 INFO [RS:1;jenkins-hbase4:38535] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 18:01:30,623 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67601710, jitterRate=0.007343977689743042}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 18:01:30,623 DEBUG [RS:1;jenkins-hbase4:38535] regionserver.HRegionServer(1947): logDir=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/WALs/jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:30,623 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 18:01:30,623 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:35157-0x1005e4b5f010001, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35157,1676570490234 2023-02-16 18:01:30,623 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 18:01:30,623 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 18:01:30,623 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 18:01:30,623 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 18:01:30,623 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 18:01:30,623 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:35157-0x1005e4b5f010001, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:30,623 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 18:01:30,623 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 18:01:30,626 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 18:01:30,626 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-16 18:01:30,626 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-16 18:01:30,627 DEBUG [RS:1;jenkins-hbase4:38535] zookeeper.ZKUtil(162): regionserver:38535-0x1005e4b5f010002, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35157,1676570490234 2023-02-16 18:01:30,628 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-16 18:01:30,628 DEBUG [RS:1;jenkins-hbase4:38535] zookeeper.ZKUtil(162): regionserver:38535-0x1005e4b5f010002, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:30,629 DEBUG [RS:1;jenkins-hbase4:38535] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 18:01:30,630 INFO [RS:1;jenkins-hbase4:38535] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 18:01:30,631 INFO [RS:1;jenkins-hbase4:38535] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 18:01:30,631 INFO [RS:1;jenkins-hbase4:38535] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 18:01:30,631 INFO [RS:1;jenkins-hbase4:38535] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:30,631 INFO [RS:0;jenkins-hbase4:35157] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 18:01:30,632 INFO [RS:1;jenkins-hbase4:38535] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 18:01:30,632 INFO [RS:0;jenkins-hbase4:35157] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35157,1676570490234-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:30,633 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-16 18:01:30,633 INFO [RS:1;jenkins-hbase4:38535] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:30,633 DEBUG [RS:1;jenkins-hbase4:38535] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:30,633 DEBUG [RS:1;jenkins-hbase4:38535] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:30,634 DEBUG [RS:1;jenkins-hbase4:38535] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:30,634 DEBUG [RS:1;jenkins-hbase4:38535] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:30,634 DEBUG [RS:1;jenkins-hbase4:38535] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:30,634 DEBUG [RS:1;jenkins-hbase4:38535] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 18:01:30,634 DEBUG [RS:1;jenkins-hbase4:38535] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:30,634 DEBUG [RS:1;jenkins-hbase4:38535] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:30,634 DEBUG [RS:1;jenkins-hbase4:38535] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:30,634 DEBUG [RS:1;jenkins-hbase4:38535] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:30,635 INFO [RS:1;jenkins-hbase4:38535] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:30,635 INFO [RS:1;jenkins-hbase4:38535] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:30,635 INFO [RS:1;jenkins-hbase4:38535] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:30,644 INFO [RS:0;jenkins-hbase4:35157] regionserver.Replication(203): jenkins-hbase4.apache.org,35157,1676570490234 started 2023-02-16 18:01:30,644 INFO [RS:0;jenkins-hbase4:35157] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,35157,1676570490234, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35157, sessionid=0x1005e4b5f010001 2023-02-16 18:01:30,644 DEBUG [RS:0;jenkins-hbase4:35157] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 18:01:30,644 DEBUG [RS:0;jenkins-hbase4:35157] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35157,1676570490234 2023-02-16 18:01:30,644 DEBUG [RS:0;jenkins-hbase4:35157] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35157,1676570490234' 2023-02-16 18:01:30,644 DEBUG [RS:0;jenkins-hbase4:35157] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:30,644 DEBUG [RS:0;jenkins-hbase4:35157] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:30,645 DEBUG [RS:0;jenkins-hbase4:35157] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 18:01:30,645 DEBUG [RS:0;jenkins-hbase4:35157] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 18:01:30,645 DEBUG [RS:0;jenkins-hbase4:35157] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35157,1676570490234 2023-02-16 18:01:30,645 DEBUG [RS:0;jenkins-hbase4:35157] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35157,1676570490234' 2023-02-16 18:01:30,645 DEBUG [RS:0;jenkins-hbase4:35157] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:30,645 DEBUG [RS:0;jenkins-hbase4:35157] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:30,645 DEBUG [RS:0;jenkins-hbase4:35157] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 18:01:30,645 INFO [RS:0;jenkins-hbase4:35157] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 18:01:30,645 INFO [RS:0;jenkins-hbase4:35157] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 18:01:30,647 INFO [RS:1;jenkins-hbase4:38535] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 18:01:30,647 INFO [RS:1;jenkins-hbase4:38535] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38535,1676570490293-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:30,657 INFO [RS:1;jenkins-hbase4:38535] regionserver.Replication(203): jenkins-hbase4.apache.org,38535,1676570490293 started 2023-02-16 18:01:30,657 INFO [RS:1;jenkins-hbase4:38535] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38535,1676570490293, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38535, sessionid=0x1005e4b5f010002 2023-02-16 18:01:30,657 DEBUG [RS:1;jenkins-hbase4:38535] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 18:01:30,657 DEBUG [RS:1;jenkins-hbase4:38535] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:30,658 DEBUG [RS:1;jenkins-hbase4:38535] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38535,1676570490293' 2023-02-16 18:01:30,658 DEBUG [RS:1;jenkins-hbase4:38535] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:30,658 DEBUG [RS:1;jenkins-hbase4:38535] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:30,658 DEBUG [RS:1;jenkins-hbase4:38535] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 18:01:30,658 DEBUG [RS:1;jenkins-hbase4:38535] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 18:01:30,658 DEBUG [RS:1;jenkins-hbase4:38535] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:30,658 DEBUG [RS:1;jenkins-hbase4:38535] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38535,1676570490293' 2023-02-16 18:01:30,658 DEBUG [RS:1;jenkins-hbase4:38535] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:30,659 DEBUG [RS:1;jenkins-hbase4:38535] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:30,659 DEBUG [RS:1;jenkins-hbase4:38535] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 18:01:30,659 INFO [RS:1;jenkins-hbase4:38535] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 18:01:30,659 INFO [RS:1;jenkins-hbase4:38535] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 18:01:30,783 DEBUG [jenkins-hbase4:37139] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-16 18:01:30,783 DEBUG [jenkins-hbase4:37139] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 18:01:30,785 DEBUG [jenkins-hbase4:37139] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 18:01:30,785 DEBUG [jenkins-hbase4:37139] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 18:01:30,785 DEBUG [jenkins-hbase4:37139] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 18:01:30,786 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38535,1676570490293, state=OPENING 2023-02-16 18:01:30,787 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-16 18:01:30,789 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:30,790 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 18:01:30,790 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38535,1676570490293}] 2023-02-16 18:01:30,944 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:30,944 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 18:01:30,946 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54816, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 18:01:30,950 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-16 18:01:30,950 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 18:01:30,952 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38535%2C1676570490293.meta, suffix=.meta, logDir=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/WALs/jenkins-hbase4.apache.org,38535,1676570490293, archiveDir=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/oldWALs, maxLogs=32 2023-02-16 18:01:30,970 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35909,DS-3cbb9df7-7a43-4b1f-8358-3f7ffcc89b39,DISK] 2023-02-16 18:01:30,970 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33709,DS-620c4cd2-7bd3-434c-b4ae-3984658dcbc5,DISK] 2023-02-16 18:01:30,972 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/WALs/jenkins-hbase4.apache.org,38535,1676570490293/jenkins-hbase4.apache.org%2C38535%2C1676570490293.meta.1676570490953.meta 2023-02-16 18:01:30,972 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35909,DS-3cbb9df7-7a43-4b1f-8358-3f7ffcc89b39,DISK], DatanodeInfoWithStorage[127.0.0.1:33709,DS-620c4cd2-7bd3-434c-b4ae-3984658dcbc5,DISK]] 2023-02-16 18:01:30,972 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-16 18:01:30,973 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-16 18:01:30,973 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-16 18:01:30,973 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-16 18:01:30,973 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-16 18:01:30,973 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:30,973 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-16 18:01:30,973 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-16 18:01:30,975 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 18:01:30,976 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/hbase/meta/1588230740/info 2023-02-16 18:01:30,976 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/hbase/meta/1588230740/info 2023-02-16 18:01:30,976 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 18:01:30,977 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:30,977 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 18:01:30,978 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/hbase/meta/1588230740/rep_barrier 2023-02-16 18:01:30,978 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/hbase/meta/1588230740/rep_barrier 2023-02-16 18:01:30,978 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 18:01:30,979 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:30,979 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 18:01:30,980 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/hbase/meta/1588230740/table 2023-02-16 18:01:30,980 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/hbase/meta/1588230740/table 2023-02-16 18:01:30,980 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 18:01:30,981 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:30,981 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/hbase/meta/1588230740 2023-02-16 18:01:30,982 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/hbase/meta/1588230740 2023-02-16 18:01:30,984 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 18:01:30,985 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 18:01:30,986 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74224840, jitterRate=0.10603630542755127}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 18:01:30,986 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 18:01:30,987 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676570490944 2023-02-16 18:01:30,991 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38535,1676570490293, state=OPEN 2023-02-16 18:01:30,992 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-16 18:01:30,992 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-16 18:01:30,994 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-16 18:01:30,994 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 18:01:30,995 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-16 18:01:30,995 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38535,1676570490293 in 204 msec 2023-02-16 18:01:30,998 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-16 18:01:30,998 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 369 msec 2023-02-16 18:01:31,000 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 489 msec 2023-02-16 18:01:31,000 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676570491000, completionTime=-1 2023-02-16 18:01:31,000 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-16 18:01:31,000 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-16 18:01:31,004 DEBUG [hconnection-0x72ba974-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 18:01:31,005 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54818, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 18:01:31,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-16 18:01:31,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676570551007 2023-02-16 18:01:31,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676570611007 2023-02-16 18:01:31,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 7 msec 2023-02-16 18:01:31,015 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37139,1676570490190-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:31,015 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37139,1676570490190-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:31,015 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37139,1676570490190-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:31,015 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:37139, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:31,015 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:31,016 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-16 18:01:31,016 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 18:01:31,017 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-16 18:01:31,018 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-16 18:01:31,022 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 18:01:31,023 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 18:01:31,024 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/.tmp/data/hbase/namespace/34d583c11c27e63a50cd3e30b0a3fa21 2023-02-16 18:01:31,025 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/.tmp/data/hbase/namespace/34d583c11c27e63a50cd3e30b0a3fa21 empty. 2023-02-16 18:01:31,025 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/.tmp/data/hbase/namespace/34d583c11c27e63a50cd3e30b0a3fa21 2023-02-16 18:01:31,025 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-16 18:01:31,037 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-16 18:01:31,038 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 34d583c11c27e63a50cd3e30b0a3fa21, NAME => 'hbase:namespace,,1676570491016.34d583c11c27e63a50cd3e30b0a3fa21.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/.tmp 2023-02-16 18:01:31,050 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676570491016.34d583c11c27e63a50cd3e30b0a3fa21.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:31,050 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 34d583c11c27e63a50cd3e30b0a3fa21, disabling compactions & flushes 2023-02-16 18:01:31,050 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676570491016.34d583c11c27e63a50cd3e30b0a3fa21. 2023-02-16 18:01:31,050 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676570491016.34d583c11c27e63a50cd3e30b0a3fa21. 2023-02-16 18:01:31,050 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676570491016.34d583c11c27e63a50cd3e30b0a3fa21. after waiting 0 ms 2023-02-16 18:01:31,050 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676570491016.34d583c11c27e63a50cd3e30b0a3fa21. 2023-02-16 18:01:31,050 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676570491016.34d583c11c27e63a50cd3e30b0a3fa21. 2023-02-16 18:01:31,050 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 34d583c11c27e63a50cd3e30b0a3fa21: 2023-02-16 18:01:31,053 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 18:01:31,064 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676570491016.34d583c11c27e63a50cd3e30b0a3fa21.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676570491064"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570491064"}]},"ts":"1676570491064"} 2023-02-16 18:01:31,067 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 18:01:31,068 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 18:01:31,068 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676570491068"}]},"ts":"1676570491068"} 2023-02-16 18:01:31,070 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-16 18:01:31,074 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 18:01:31,075 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 18:01:31,075 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 18:01:31,075 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 18:01:31,075 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=34d583c11c27e63a50cd3e30b0a3fa21, ASSIGN}] 2023-02-16 18:01:31,078 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=34d583c11c27e63a50cd3e30b0a3fa21, ASSIGN 2023-02-16 18:01:31,079 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=34d583c11c27e63a50cd3e30b0a3fa21, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38535,1676570490293; forceNewPlan=false, retain=false 2023-02-16 18:01:31,229 INFO [jenkins-hbase4:37139] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 18:01:31,230 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=34d583c11c27e63a50cd3e30b0a3fa21, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:31,230 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676570491016.34d583c11c27e63a50cd3e30b0a3fa21.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676570491230"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570491230"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570491230"}]},"ts":"1676570491230"} 2023-02-16 18:01:31,232 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 34d583c11c27e63a50cd3e30b0a3fa21, server=jenkins-hbase4.apache.org,38535,1676570490293}] 2023-02-16 18:01:31,387 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676570491016.34d583c11c27e63a50cd3e30b0a3fa21. 2023-02-16 18:01:31,388 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38535%2C1676570490293, suffix=, logDir=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/WALs/jenkins-hbase4.apache.org,38535,1676570490293, archiveDir=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/oldWALs, maxLogs=32 2023-02-16 18:01:31,403 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33709,DS-620c4cd2-7bd3-434c-b4ae-3984658dcbc5,DISK] 2023-02-16 18:01:31,403 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35909,DS-3cbb9df7-7a43-4b1f-8358-3f7ffcc89b39,DISK] 2023-02-16 18:01:31,405 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/WALs/jenkins-hbase4.apache.org,38535,1676570490293/jenkins-hbase4.apache.org%2C38535%2C1676570490293.1676570491389 2023-02-16 18:01:31,405 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35909,DS-3cbb9df7-7a43-4b1f-8358-3f7ffcc89b39,DISK], DatanodeInfoWithStorage[127.0.0.1:33709,DS-620c4cd2-7bd3-434c-b4ae-3984658dcbc5,DISK]] 2023-02-16 18:01:31,405 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 34d583c11c27e63a50cd3e30b0a3fa21, NAME => 'hbase:namespace,,1676570491016.34d583c11c27e63a50cd3e30b0a3fa21.', STARTKEY => '', ENDKEY => ''} 2023-02-16 18:01:31,405 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 34d583c11c27e63a50cd3e30b0a3fa21 2023-02-16 18:01:31,405 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676570491016.34d583c11c27e63a50cd3e30b0a3fa21.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:31,405 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 34d583c11c27e63a50cd3e30b0a3fa21 2023-02-16 18:01:31,405 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 34d583c11c27e63a50cd3e30b0a3fa21 2023-02-16 18:01:31,407 INFO [StoreOpener-34d583c11c27e63a50cd3e30b0a3fa21-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 34d583c11c27e63a50cd3e30b0a3fa21 2023-02-16 18:01:31,408 DEBUG [StoreOpener-34d583c11c27e63a50cd3e30b0a3fa21-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/hbase/namespace/34d583c11c27e63a50cd3e30b0a3fa21/info 2023-02-16 18:01:31,408 DEBUG [StoreOpener-34d583c11c27e63a50cd3e30b0a3fa21-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/hbase/namespace/34d583c11c27e63a50cd3e30b0a3fa21/info 2023-02-16 18:01:31,408 INFO [StoreOpener-34d583c11c27e63a50cd3e30b0a3fa21-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34d583c11c27e63a50cd3e30b0a3fa21 columnFamilyName info 2023-02-16 18:01:31,409 INFO [StoreOpener-34d583c11c27e63a50cd3e30b0a3fa21-1] regionserver.HStore(310): Store=34d583c11c27e63a50cd3e30b0a3fa21/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:31,409 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/hbase/namespace/34d583c11c27e63a50cd3e30b0a3fa21 2023-02-16 18:01:31,410 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/hbase/namespace/34d583c11c27e63a50cd3e30b0a3fa21 2023-02-16 18:01:31,412 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 34d583c11c27e63a50cd3e30b0a3fa21 2023-02-16 18:01:31,413 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/hbase/namespace/34d583c11c27e63a50cd3e30b0a3fa21/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:31,414 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 34d583c11c27e63a50cd3e30b0a3fa21; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70562240, jitterRate=0.051459312438964844}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 18:01:31,414 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 34d583c11c27e63a50cd3e30b0a3fa21: 2023-02-16 18:01:31,414 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676570491016.34d583c11c27e63a50cd3e30b0a3fa21., pid=6, masterSystemTime=1676570491384 2023-02-16 18:01:31,416 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676570491016.34d583c11c27e63a50cd3e30b0a3fa21. 2023-02-16 18:01:31,416 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676570491016.34d583c11c27e63a50cd3e30b0a3fa21. 2023-02-16 18:01:31,416 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=34d583c11c27e63a50cd3e30b0a3fa21, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:31,416 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676570491016.34d583c11c27e63a50cd3e30b0a3fa21.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676570491416"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676570491416"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676570491416"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676570491416"}]},"ts":"1676570491416"} 2023-02-16 18:01:31,419 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-16 18:01:31,419 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 34d583c11c27e63a50cd3e30b0a3fa21, server=jenkins-hbase4.apache.org,38535,1676570490293 in 186 msec 2023-02-16 18:01:31,421 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-16 18:01:31,421 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=34d583c11c27e63a50cd3e30b0a3fa21, ASSIGN in 344 msec 2023-02-16 18:01:31,421 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 18:01:31,421 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676570491421"}]},"ts":"1676570491421"} 2023-02-16 18:01:31,423 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-16 18:01:31,425 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 18:01:31,426 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 409 msec 2023-02-16 18:01:31,518 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-16 18:01:31,520 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-16 18:01:31,520 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:31,524 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-16 18:01:31,532 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 18:01:31,536 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-02-16 18:01:31,547 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-16 18:01:31,557 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 18:01:31,560 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 13 msec 2023-02-16 18:01:31,571 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-16 18:01:31,574 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-16 18:01:31,574 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.224sec 2023-02-16 18:01:31,574 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-16 18:01:31,574 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-16 18:01:31,574 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-16 18:01:31,574 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37139,1676570490190-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-16 18:01:31,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37139,1676570490190-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-16 18:01:31,576 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-16 18:01:31,639 DEBUG [Listener at localhost/39309] zookeeper.ReadOnlyZKClient(139): Connect 0x5fc685f7 to 127.0.0.1:50324 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 18:01:31,643 DEBUG [Listener at localhost/39309] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@344f4981, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 18:01:31,645 DEBUG [hconnection-0x45677121-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 18:01:31,647 INFO [RS-EventLoopGroup-11-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54832, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 18:01:31,647 INFO [RS:0;jenkins-hbase4:35157] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35157%2C1676570490234, suffix=, logDir=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/WALs/jenkins-hbase4.apache.org,35157,1676570490234, archiveDir=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/oldWALs, maxLogs=32 2023-02-16 18:01:31,648 INFO [Listener at localhost/39309] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,37139,1676570490190 2023-02-16 18:01:31,649 DEBUG [Listener at localhost/39309] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-16 18:01:31,651 DEBUG [Listener at localhost/39309] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-16 18:01:31,652 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49498, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-16 18:01:31,653 INFO [Listener at localhost/39309] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:31,653 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:31,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-16 18:01:31,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 96 connection: 172.31.14.131:49498 deadline: 1676570551653, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:31,654 INFO [Listener at localhost/39309] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-16 18:01:31,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 18:01:31,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:31,658 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 18:01:31,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-16 18:01:31,659 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 18:01:31,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 18:01:31,661 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/.tmp/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693 2023-02-16 18:01:31,661 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/.tmp/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693 empty. 2023-02-16 18:01:31,661 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/.tmp/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693 2023-02-16 18:01:31,661 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-16 18:01:31,668 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35909,DS-3cbb9df7-7a43-4b1f-8358-3f7ffcc89b39,DISK] 2023-02-16 18:01:31,668 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33709,DS-620c4cd2-7bd3-434c-b4ae-3984658dcbc5,DISK] 2023-02-16 18:01:31,671 INFO [RS:0;jenkins-hbase4:35157] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/WALs/jenkins-hbase4.apache.org,35157,1676570490234/jenkins-hbase4.apache.org%2C35157%2C1676570490234.1676570491647 2023-02-16 18:01:31,671 DEBUG [RS:0;jenkins-hbase4:35157] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35909,DS-3cbb9df7-7a43-4b1f-8358-3f7ffcc89b39,DISK], DatanodeInfoWithStorage[127.0.0.1:33709,DS-620c4cd2-7bd3-434c-b4ae-3984658dcbc5,DISK]] 2023-02-16 18:01:31,674 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-16 18:01:31,675 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => dc2d5929f9026c392ba14cee329e1693, NAME => 'testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/.tmp 2023-02-16 18:01:31,681 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:31,681 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing dc2d5929f9026c392ba14cee329e1693, disabling compactions & flushes 2023-02-16 18:01:31,682 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693. 2023-02-16 18:01:31,682 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693. 2023-02-16 18:01:31,682 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693. after waiting 0 ms 2023-02-16 18:01:31,682 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693. 2023-02-16 18:01:31,682 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693. 2023-02-16 18:01:31,682 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for dc2d5929f9026c392ba14cee329e1693: 2023-02-16 18:01:31,684 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 18:01:31,685 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676570491685"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570491685"}]},"ts":"1676570491685"} 2023-02-16 18:01:31,686 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 18:01:31,687 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 18:01:31,687 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676570491687"}]},"ts":"1676570491687"} 2023-02-16 18:01:31,689 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-16 18:01:31,695 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 18:01:31,696 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 18:01:31,696 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 18:01:31,696 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 18:01:31,697 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=dc2d5929f9026c392ba14cee329e1693, ASSIGN}] 2023-02-16 18:01:31,699 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=dc2d5929f9026c392ba14cee329e1693, ASSIGN 2023-02-16 18:01:31,701 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=dc2d5929f9026c392ba14cee329e1693, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38535,1676570490293; forceNewPlan=false, retain=false 2023-02-16 18:01:31,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 18:01:31,851 INFO [jenkins-hbase4:37139] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 18:01:31,852 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=dc2d5929f9026c392ba14cee329e1693, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:31,852 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676570491852"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570491852"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570491852"}]},"ts":"1676570491852"} 2023-02-16 18:01:31,854 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure dc2d5929f9026c392ba14cee329e1693, server=jenkins-hbase4.apache.org,38535,1676570490293}] 2023-02-16 18:01:31,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 18:01:32,016 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693. 2023-02-16 18:01:32,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => dc2d5929f9026c392ba14cee329e1693, NAME => 'testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693.', STARTKEY => '', ENDKEY => ''} 2023-02-16 18:01:32,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig dc2d5929f9026c392ba14cee329e1693 2023-02-16 18:01:32,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:32,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for dc2d5929f9026c392ba14cee329e1693 2023-02-16 18:01:32,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for dc2d5929f9026c392ba14cee329e1693 2023-02-16 18:01:32,018 INFO [StoreOpener-dc2d5929f9026c392ba14cee329e1693-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region dc2d5929f9026c392ba14cee329e1693 2023-02-16 18:01:32,020 DEBUG [StoreOpener-dc2d5929f9026c392ba14cee329e1693-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693/f1 2023-02-16 18:01:32,020 DEBUG [StoreOpener-dc2d5929f9026c392ba14cee329e1693-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693/f1 2023-02-16 18:01:32,020 INFO [StoreOpener-dc2d5929f9026c392ba14cee329e1693-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dc2d5929f9026c392ba14cee329e1693 columnFamilyName f1 2023-02-16 18:01:32,021 INFO [StoreOpener-dc2d5929f9026c392ba14cee329e1693-1] regionserver.HStore(310): Store=dc2d5929f9026c392ba14cee329e1693/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:32,021 INFO [StoreOpener-dc2d5929f9026c392ba14cee329e1693-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region dc2d5929f9026c392ba14cee329e1693 2023-02-16 18:01:32,022 DEBUG [StoreOpener-dc2d5929f9026c392ba14cee329e1693-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693/f2 2023-02-16 18:01:32,022 DEBUG [StoreOpener-dc2d5929f9026c392ba14cee329e1693-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693/f2 2023-02-16 18:01:32,023 INFO [StoreOpener-dc2d5929f9026c392ba14cee329e1693-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dc2d5929f9026c392ba14cee329e1693 columnFamilyName f2 2023-02-16 18:01:32,023 INFO [StoreOpener-dc2d5929f9026c392ba14cee329e1693-1] regionserver.HStore(310): Store=dc2d5929f9026c392ba14cee329e1693/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:32,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693 2023-02-16 18:01:32,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693 2023-02-16 18:01:32,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:32,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for dc2d5929f9026c392ba14cee329e1693 2023-02-16 18:01:32,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:32,035 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened dc2d5929f9026c392ba14cee329e1693; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75450922, jitterRate=0.12430635094642639}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:32,035 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for dc2d5929f9026c392ba14cee329e1693: 2023-02-16 18:01:32,036 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693., pid=12, masterSystemTime=1676570492007 2023-02-16 18:01:32,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693. 2023-02-16 18:01:32,038 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693. 2023-02-16 18:01:32,039 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=dc2d5929f9026c392ba14cee329e1693, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:32,039 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676570492038"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676570492038"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676570492038"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676570492038"}]},"ts":"1676570492038"} 2023-02-16 18:01:32,043 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-16 18:01:32,043 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure dc2d5929f9026c392ba14cee329e1693, server=jenkins-hbase4.apache.org,38535,1676570490293 in 186 msec 2023-02-16 18:01:32,046 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-16 18:01:32,046 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=dc2d5929f9026c392ba14cee329e1693, ASSIGN in 346 msec 2023-02-16 18:01:32,046 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 18:01:32,047 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676570492047"}]},"ts":"1676570492047"} 2023-02-16 18:01:32,048 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-16 18:01:32,051 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 18:01:32,052 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 395 msec 2023-02-16 18:01:32,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 18:01:32,264 INFO [Listener at localhost/39309] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-16 18:01:32,265 DEBUG [Listener at localhost/39309] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-16 18:01:32,265 INFO [Listener at localhost/39309] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 18:01:32,267 INFO [Listener at localhost/39309] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-16 18:01:32,267 INFO [Listener at localhost/39309] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 18:01:32,267 INFO [Listener at localhost/39309] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-16 18:01:32,267 INFO [Listener at localhost/39309] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-16 18:01:32,645 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38535] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693. 2023-02-16 18:01:32,828 INFO [Listener at localhost/39309] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-16 18:01:32,828 INFO [Listener at localhost/39309] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-16 18:01:32,830 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-16 18:01:32,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676570492830 (current time:1676570492830). 2023-02-16 18:01:32,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-16 18:01:32,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] zookeeper.ReadOnlyZKClient(139): Connect 0x5ca7f261 to 127.0.0.1:50324 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 18:01:32,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63010b7f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 18:01:32,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 18:01:32,845 INFO [RS-EventLoopGroup-11-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54842, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 18:01:32,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5ca7f261 to 127.0.0.1:50324 2023-02-16 18:01:32,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:32,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-16 18:01:32,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-16 18:01:32,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-16 18:01:32,850 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-16 18:01:32,851 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1676571092851 2023-02-16 18:01:32,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-16 18:01:32,856 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:32,858 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-16 18:01:32,858 DEBUG [Listener at localhost/39309] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-16 18:01:32,858 DEBUG [Listener at localhost/39309] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-16 18:01:32,859 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-16 18:01:32,859 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 10 msec 2023-02-16 18:01:32,861 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-16 18:01:32,861 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1676571092861 2023-02-16 18:01:32,876 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-16 18:01:32,876 INFO [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-16 18:01:32,876 DEBUG [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 18:01:32,877 DEBUG [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-16 18:01:32,878 DEBUG [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-16 18:01:32,878 DEBUG [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-16 18:01:32,878 DEBUG [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-16 18:01:32,879 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:38535-0x1005e4b5f010002, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 18:01:32,879 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:35157-0x1005e4b5f010001, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 18:01:32,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 18:01:32,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 18:01:32,879 DEBUG [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:32,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:32,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:32,880 DEBUG [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:32,880 DEBUG [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 18:01:32,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-16 18:01:32,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-16 18:01:32,880 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38535-0x1005e4b5f010002, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-16 18:01:32,880 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35157-0x1005e4b5f010001, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-16 18:01:32,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-16 18:01:32,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-16 18:01:32,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-16 18:01:32,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-16 18:01:32,881 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-16 18:01:32,881 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-16 18:01:32,881 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-16 18:01:32,881 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-16 18:01:32,881 DEBUG [member: 'jenkins-hbase4.apache.org,35157,1676570490234' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-16 18:01:32,881 DEBUG [member: 'jenkins-hbase4.apache.org,38535,1676570490293' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-16 18:01:32,881 DEBUG [member: 'jenkins-hbase4.apache.org,38535,1676570490293' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 18:01:32,881 DEBUG [member: 'jenkins-hbase4.apache.org,35157,1676570490234' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 18:01:32,882 DEBUG [member: 'jenkins-hbase4.apache.org,38535,1676570490293' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-16 18:01:32,883 DEBUG [member: 'jenkins-hbase4.apache.org,38535,1676570490293' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-16 18:01:32,883 DEBUG [member: 'jenkins-hbase4.apache.org,35157,1676570490234' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-16 18:01:32,883 DEBUG [member: 'jenkins-hbase4.apache.org,35157,1676570490234' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-16 18:01:32,883 DEBUG [member: 'jenkins-hbase4.apache.org,35157,1676570490234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35157,1676570490234' joining acquired barrier for procedure (foo) in zk 2023-02-16 18:01:32,883 DEBUG [member: 'jenkins-hbase4.apache.org,38535,1676570490293' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38535,1676570490293' joining acquired barrier for procedure (foo) in zk 2023-02-16 18:01:32,889 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:32,889 DEBUG [member: 'jenkins-hbase4.apache.org,38535,1676570490293' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-16 18:01:32,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:32,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:32,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 18:01:32,889 DEBUG [member: 'jenkins-hbase4.apache.org,38535,1676570490293' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38535-0x1005e4b5f010002, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-16 18:01:32,889 DEBUG [member: 'jenkins-hbase4.apache.org,38535,1676570490293' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 18:01:32,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:32,889 DEBUG [member: 'jenkins-hbase4.apache.org,35157,1676570490234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-16 18:01:32,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:32,890 DEBUG [member: 'jenkins-hbase4.apache.org,35157,1676570490234' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35157-0x1005e4b5f010001, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-16 18:01:32,890 DEBUG [member: 'jenkins-hbase4.apache.org,35157,1676570490234' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 18:01:32,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 18:01:32,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:32,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35157,1676570490234 2023-02-16 18:01:32,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:32,893 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38535,1676570490293' joining acquired barrier for procedure 'foo' on coordinator 2023-02-16 18:01:32,893 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e44d2e3[Count = 0] remaining members to acquire global barrier 2023-02-16 18:01:32,893 DEBUG [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-16 18:01:32,893 DEBUG [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-16 18:01:32,894 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:38535-0x1005e4b5f010002, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-16 18:01:32,894 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:35157-0x1005e4b5f010001, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-16 18:01:32,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-16 18:01:32,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-16 18:01:32,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-16 18:01:32,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-16 18:01:32,894 DEBUG [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:32,894 DEBUG [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 18:01:32,894 DEBUG [member: 'jenkins-hbase4.apache.org,38535,1676570490293' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-16 18:01:32,894 DEBUG [member: 'jenkins-hbase4.apache.org,35157,1676570490234' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-16 18:01:32,894 DEBUG [member: 'jenkins-hbase4.apache.org,35157,1676570490234' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-16 18:01:32,894 DEBUG [member: 'jenkins-hbase4.apache.org,35157,1676570490234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,35157,1676570490234' in zk 2023-02-16 18:01:32,896 DEBUG [member: 'jenkins-hbase4.apache.org,35157,1676570490234' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-16 18:01:32,896 DEBUG [member: 'jenkins-hbase4.apache.org,35157,1676570490234' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:32,896 DEBUG [member: 'jenkins-hbase4.apache.org,35157,1676570490234' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-16 18:01:32,904 DEBUG [member: 'jenkins-hbase4.apache.org,38535,1676570490293' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-16 18:01:32,905 DEBUG [rs(jenkins-hbase4.apache.org,38535,1676570490293)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693. 2023-02-16 18:01:32,905 DEBUG [member: 'jenkins-hbase4.apache.org,38535,1676570490293' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 18:01:32,905 DEBUG [rs(jenkins-hbase4.apache.org,38535,1676570490293)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693. started... 2023-02-16 18:01:32,906 INFO [rs(jenkins-hbase4.apache.org,38535,1676570490293)-snapshot-pool-0] regionserver.HRegion(2744): Flushing dc2d5929f9026c392ba14cee329e1693 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-16 18:01:32,930 INFO [rs(jenkins-hbase4.apache.org,38535,1676570490293)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693/.tmp/f1/7a394c374dc442d39832518d2412a5e3 2023-02-16 18:01:32,958 INFO [rs(jenkins-hbase4.apache.org,38535,1676570490293)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693/.tmp/f2/cb5a38990d9d42de8fc583e08fb3a3f7 2023-02-16 18:01:32,958 DEBUG [Listener at localhost/39309] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 18:01:32,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-16 18:01:32,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-16 18:01:32,960 DEBUG [Listener at localhost/39309] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-16 18:01:32,964 DEBUG [rs(jenkins-hbase4.apache.org,38535,1676570490293)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693/.tmp/f1/7a394c374dc442d39832518d2412a5e3 as hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693/f1/7a394c374dc442d39832518d2412a5e3 2023-02-16 18:01:32,970 INFO [rs(jenkins-hbase4.apache.org,38535,1676570490293)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693/f1/7a394c374dc442d39832518d2412a5e3, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-16 18:01:32,971 DEBUG [rs(jenkins-hbase4.apache.org,38535,1676570490293)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693/.tmp/f2/cb5a38990d9d42de8fc583e08fb3a3f7 as hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693/f2/cb5a38990d9d42de8fc583e08fb3a3f7 2023-02-16 18:01:32,980 INFO [rs(jenkins-hbase4.apache.org,38535,1676570490293)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693/f2/cb5a38990d9d42de8fc583e08fb3a3f7, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-16 18:01:32,982 INFO [rs(jenkins-hbase4.apache.org,38535,1676570490293)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for dc2d5929f9026c392ba14cee329e1693 in 77ms, sequenceid=5, compaction requested=false 2023-02-16 18:01:32,982 DEBUG [rs(jenkins-hbase4.apache.org,38535,1676570490293)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-16 18:01:32,982 DEBUG [rs(jenkins-hbase4.apache.org,38535,1676570490293)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for dc2d5929f9026c392ba14cee329e1693: 2023-02-16 18:01:32,982 DEBUG [rs(jenkins-hbase4.apache.org,38535,1676570490293)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693.' region-info for snapshot=foo 2023-02-16 18:01:32,982 DEBUG [rs(jenkins-hbase4.apache.org,38535,1676570490293)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 18:01:32,982 DEBUG [rs(jenkins-hbase4.apache.org,38535,1676570490293)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693/f1/7a394c374dc442d39832518d2412a5e3] hfiles 2023-02-16 18:01:32,983 DEBUG [rs(jenkins-hbase4.apache.org,38535,1676570490293)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693/f1/7a394c374dc442d39832518d2412a5e3 for snapshot=foo 2023-02-16 18:01:32,983 DEBUG [rs(jenkins-hbase4.apache.org,38535,1676570490293)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693/f2/cb5a38990d9d42de8fc583e08fb3a3f7] hfiles 2023-02-16 18:01:32,983 DEBUG [rs(jenkins-hbase4.apache.org,38535,1676570490293)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693/f2/cb5a38990d9d42de8fc583e08fb3a3f7 for snapshot=foo 2023-02-16 18:01:32,996 DEBUG [rs(jenkins-hbase4.apache.org,38535,1676570490293)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693. completed. 2023-02-16 18:01:32,997 DEBUG [rs(jenkins-hbase4.apache.org,38535,1676570490293)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693. 2023-02-16 18:01:32,997 DEBUG [member: 'jenkins-hbase4.apache.org,38535,1676570490293' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-16 18:01:32,997 DEBUG [member: 'jenkins-hbase4.apache.org,38535,1676570490293' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-16 18:01:32,997 DEBUG [member: 'jenkins-hbase4.apache.org,38535,1676570490293' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:32,997 DEBUG [member: 'jenkins-hbase4.apache.org,38535,1676570490293' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-16 18:01:32,997 DEBUG [member: 'jenkins-hbase4.apache.org,38535,1676570490293' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,38535,1676570490293' in zk 2023-02-16 18:01:32,999 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:32,999 DEBUG [member: 'jenkins-hbase4.apache.org,38535,1676570490293' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-16 18:01:33,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:33,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:33,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 18:01:33,000 DEBUG [member: 'jenkins-hbase4.apache.org,38535,1676570490293' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:33,000 DEBUG [member: 'jenkins-hbase4.apache.org,38535,1676570490293' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-16 18:01:33,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:33,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:33,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 18:01:33,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:33,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35157,1676570490234 2023-02-16 18:01:33,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:33,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 18:01:33,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35157,1676570490234 2023-02-16 18:01:33,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:33,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,38535,1676570490293': 2023-02-16 18:01:33,004 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38535,1676570490293' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-16 18:01:33,004 INFO [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-16 18:01:33,004 DEBUG [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 18:01:33,004 DEBUG [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 18:01:33,004 DEBUG [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-16 18:01:33,004 INFO [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-16 18:01:33,006 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:38535-0x1005e4b5f010002, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-16 18:01:33,006 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-16 18:01:33,006 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:38535-0x1005e4b5f010002, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 18:01:33,006 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:35157-0x1005e4b5f010001, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-16 18:01:33,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-16 18:01:33,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-16 18:01:33,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:33,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 18:01:33,006 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:35157-0x1005e4b5f010001, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 18:01:33,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-16 18:01:33,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-16 18:01:33,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-16 18:01:33,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 18:01:33,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:33,007 DEBUG [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:33,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:33,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 18:01:33,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:33,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 18:01:33,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-16 18:01:33,007 DEBUG [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,35157,1676570490234 2023-02-16 18:01:33,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-16 18:01:33,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:33,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 18:01:33,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:33,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35157,1676570490234 2023-02-16 18:01:33,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:33,009 DEBUG [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,35157,1676570490234 2023-02-16 18:01:33,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 18:01:33,009 DEBUG [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:33,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35157,1676570490234 2023-02-16 18:01:33,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:33,016 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:38535-0x1005e4b5f010002, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 18:01:33,016 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:35157-0x1005e4b5f010001, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 18:01:33,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 18:01:33,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:33,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 18:01:33,017 DEBUG [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:33,017 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,35157,1676570490234 2023-02-16 18:01:33,017 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-16 18:01:33,016 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:38535-0x1005e4b5f010002, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 18:01:33,018 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:33,017 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-16 18:01:33,018 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-16 18:01:33,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 18:01:33,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:33,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:33,017 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:35157-0x1005e4b5f010001, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 18:01:33,018 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-16 18:01:33,018 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:33,018 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-16 18:01:33,018 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,35157,1676570490234 2023-02-16 18:01:33,018 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-16 18:01:33,019 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-16 18:01:33,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 18:01:33,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:33,019 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/.hbase-snapshot/.tmp/foo 2023-02-16 18:01:33,041 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/.hbase-snapshot/.tmp/foo to hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/.hbase-snapshot/foo 2023-02-16 18:01:33,058 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-16 18:01:33,058 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/.hbase-snapshot/.tmp/foo 2023-02-16 18:01:33,058 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/.hbase-snapshot/.tmp/foo 2023-02-16 18:01:33,059 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1676570492856Consolidate snapshot: foo at 1676570493018 (+162 ms)Loading Region manifests for foo at 1676570493018Writing data manifest for foo at 1676570493022 (+4 ms)Verifying snapshot: foo at 1676570493031 (+9 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1676570493058 (+27 ms) 2023-02-16 18:01:33,060 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-16 18:01:33,061 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 202 msec 2023-02-16 18:01:33,160 DEBUG [Listener at localhost/39309] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 18:01:33,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-16 18:01:33,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-16 18:01:33,162 INFO [Listener at localhost/39309] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-16 18:01:33,166 INFO [Listener at localhost/39309] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-16 18:01:33,171 INFO [Listener at localhost/39309] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-16 18:01:33,221 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38535] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693. 2023-02-16 18:01:33,310 INFO [Listener at localhost/39309] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-16 18:01:33,316 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-16 18:01:33,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,318 INFO [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-16 18:01:33,318 DEBUG [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 18:01:33,318 DEBUG [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-16 18:01:33,318 DEBUG [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-16 18:01:33,319 DEBUG [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,319 DEBUG [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,320 DEBUG [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:33,320 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:35157-0x1005e4b5f010001, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 18:01:33,320 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:38535-0x1005e4b5f010002, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 18:01:33,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 18:01:33,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:33,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 18:01:33,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:33,320 DEBUG [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:33,320 DEBUG [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 18:01:33,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,321 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35157-0x1005e4b5f010001, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,321 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38535-0x1005e4b5f010002, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 18:01:33,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,321 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,321 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 18:01:33,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,322 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,322 DEBUG [member: 'jenkins-hbase4.apache.org,35157,1676570490234' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-16 18:01:33,322 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,322 DEBUG [member: 'jenkins-hbase4.apache.org,35157,1676570490234' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 18:01:33,322 DEBUG [member: 'jenkins-hbase4.apache.org,35157,1676570490234' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-16 18:01:33,322 DEBUG [member: 'jenkins-hbase4.apache.org,35157,1676570490234' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-16 18:01:33,322 DEBUG [member: 'jenkins-hbase4.apache.org,38535,1676570490293' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-16 18:01:33,323 DEBUG [member: 'jenkins-hbase4.apache.org,38535,1676570490293' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 18:01:33,323 DEBUG [member: 'jenkins-hbase4.apache.org,35157,1676570490234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35157,1676570490234' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-16 18:01:33,323 DEBUG [member: 'jenkins-hbase4.apache.org,38535,1676570490293' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-16 18:01:33,323 DEBUG [member: 'jenkins-hbase4.apache.org,38535,1676570490293' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-16 18:01:33,323 DEBUG [member: 'jenkins-hbase4.apache.org,38535,1676570490293' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 18:01:33,323 DEBUG [rs(jenkins-hbase4.apache.org,38535,1676570490293)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693. 2023-02-16 18:01:33,323 DEBUG [rs(jenkins-hbase4.apache.org,38535,1676570490293)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693. started... 2023-02-16 18:01:33,323 INFO [rs(jenkins-hbase4.apache.org,38535,1676570490293)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing dc2d5929f9026c392ba14cee329e1693 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-16 18:01:33,325 DEBUG [member: 'jenkins-hbase4.apache.org,35157,1676570490234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,325 DEBUG [member: 'jenkins-hbase4.apache.org,35157,1676570490234' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35157-0x1005e4b5f010001, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,325 DEBUG [member: 'jenkins-hbase4.apache.org,35157,1676570490234' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 18:01:33,339 INFO [rs(jenkins-hbase4.apache.org,38535,1676570490293)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693/.tmp/f1/308813292f0b4948a5bda70e3fa2ba71 2023-02-16 18:01:33,360 INFO [rs(jenkins-hbase4.apache.org,38535,1676570490293)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693/.tmp/f2/26746f0c32e740ef8575c7e294ddf144 2023-02-16 18:01:33,369 DEBUG [rs(jenkins-hbase4.apache.org,38535,1676570490293)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693/.tmp/f1/308813292f0b4948a5bda70e3fa2ba71 as hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693/f1/308813292f0b4948a5bda70e3fa2ba71 2023-02-16 18:01:33,375 INFO [rs(jenkins-hbase4.apache.org,38535,1676570490293)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693/f1/308813292f0b4948a5bda70e3fa2ba71, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-16 18:01:33,377 DEBUG [rs(jenkins-hbase4.apache.org,38535,1676570490293)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693/.tmp/f2/26746f0c32e740ef8575c7e294ddf144 as hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693/f2/26746f0c32e740ef8575c7e294ddf144 2023-02-16 18:01:33,383 INFO [rs(jenkins-hbase4.apache.org,38535,1676570490293)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693/f2/26746f0c32e740ef8575c7e294ddf144, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-16 18:01:33,384 INFO [rs(jenkins-hbase4.apache.org,38535,1676570490293)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for dc2d5929f9026c392ba14cee329e1693 in 61ms, sequenceid=9, compaction requested=false 2023-02-16 18:01:33,385 DEBUG [rs(jenkins-hbase4.apache.org,38535,1676570490293)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for dc2d5929f9026c392ba14cee329e1693: 2023-02-16 18:01:33,385 DEBUG [rs(jenkins-hbase4.apache.org,38535,1676570490293)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693. 2023-02-16 18:01:33,385 DEBUG [member: 'jenkins-hbase4.apache.org,38535,1676570490293' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-16 18:01:33,385 DEBUG [member: 'jenkins-hbase4.apache.org,38535,1676570490293' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-16 18:01:33,385 DEBUG [member: 'jenkins-hbase4.apache.org,38535,1676570490293' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:33,385 DEBUG [member: 'jenkins-hbase4.apache.org,38535,1676570490293' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-16 18:01:33,385 DEBUG [member: 'jenkins-hbase4.apache.org,38535,1676570490293' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38535,1676570490293' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-16 18:01:33,388 DEBUG [member: 'jenkins-hbase4.apache.org,38535,1676570490293' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,388 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:33,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:33,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:33,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 18:01:33,388 DEBUG [member: 'jenkins-hbase4.apache.org,38535,1676570490293' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38535-0x1005e4b5f010002, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,389 DEBUG [member: 'jenkins-hbase4.apache.org,38535,1676570490293' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 18:01:33,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:33,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:33,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35157,1676570490234 2023-02-16 18:01:33,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:33,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:33,390 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38535,1676570490293' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-16 18:01:33,390 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a7b49f3[Count = 0] remaining members to acquire global barrier 2023-02-16 18:01:33,390 DEBUG [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-16 18:01:33,390 DEBUG [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,391 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:38535-0x1005e4b5f010002, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,391 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:35157-0x1005e4b5f010001, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,392 DEBUG [member: 'jenkins-hbase4.apache.org,38535,1676570490293' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-16 18:01:33,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,392 DEBUG [member: 'jenkins-hbase4.apache.org,38535,1676570490293' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-16 18:01:33,392 DEBUG [member: 'jenkins-hbase4.apache.org,35157,1676570490234' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-16 18:01:33,392 DEBUG [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:33,392 DEBUG [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 18:01:33,392 DEBUG [member: 'jenkins-hbase4.apache.org,38535,1676570490293' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,38535,1676570490293' in zk 2023-02-16 18:01:33,392 DEBUG [member: 'jenkins-hbase4.apache.org,35157,1676570490234' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-16 18:01:33,392 DEBUG [member: 'jenkins-hbase4.apache.org,35157,1676570490234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,35157,1676570490234' in zk 2023-02-16 18:01:33,394 DEBUG [member: 'jenkins-hbase4.apache.org,35157,1676570490234' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-16 18:01:33,394 DEBUG [member: 'jenkins-hbase4.apache.org,35157,1676570490234' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:33,394 DEBUG [member: 'jenkins-hbase4.apache.org,35157,1676570490234' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-16 18:01:33,395 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:33,395 DEBUG [member: 'jenkins-hbase4.apache.org,38535,1676570490293' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-16 18:01:33,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:33,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:33,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 18:01:33,395 DEBUG [member: 'jenkins-hbase4.apache.org,38535,1676570490293' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:33,396 DEBUG [member: 'jenkins-hbase4.apache.org,38535,1676570490293' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-16 18:01:33,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:33,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:33,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35157,1676570490234 2023-02-16 18:01:33,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:33,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:33,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35157,1676570490234 2023-02-16 18:01:33,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:33,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase4.apache.org,38535,1676570490293': 2023-02-16 18:01:33,401 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38535,1676570490293' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-16 18:01:33,401 INFO [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-16 18:01:33,401 DEBUG [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 18:01:33,401 DEBUG [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 18:01:33,401 DEBUG [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,401 INFO [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-16 18:01:33,404 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:38535-0x1005e4b5f010002, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,404 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,404 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:38535-0x1005e4b5f010002, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 18:01:33,404 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:35157-0x1005e4b5f010001, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,404 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:35157-0x1005e4b5f010001, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 18:01:33,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:33,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 18:01:33,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,405 DEBUG [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,35157,1676570490234 2023-02-16 18:01:33,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:33,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 18:01:33,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:33,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 18:01:33,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:33,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,406 DEBUG [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:33,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:33,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35157,1676570490234 2023-02-16 18:01:33,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:33,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:33,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35157,1676570490234 2023-02-16 18:01:33,411 DEBUG [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,35157,1676570490234 2023-02-16 18:01:33,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:33,411 DEBUG [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:33,418 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:33,418 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,418 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,35157,1676570490234 2023-02-16 18:01:33,418 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,418 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:35157-0x1005e4b5f010001, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 18:01:33,418 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:33,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 18:01:33,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:33,418 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:38535-0x1005e4b5f010002, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 18:01:33,418 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:38535-0x1005e4b5f010002, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 18:01:33,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-16 18:01:33,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-16 18:01:33,418 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,419 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,35157,1676570490234 2023-02-16 18:01:33,419 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,419 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,418 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:35157-0x1005e4b5f010001, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 18:01:33,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 18:01:33,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:33,418 DEBUG [(jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:33,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 18:01:33,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:33,424 DEBUG [Listener at localhost/39309] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-16 18:01:33,425 DEBUG [Listener at localhost/39309] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-16 18:01:33,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 18:01:33,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:33,525 DEBUG [Listener at localhost/39309] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-16 18:01:33,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-16 18:01:33,530 INFO [Listener at localhost/39309] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676570492830 type: FLUSH version: 2 ttl: 0 2023-02-16 18:01:33,531 DEBUG [Listener at localhost/39309] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:42551/user/jenkins/test-data/9e945780-56f7-6df0-3aa5-9060846ea363/foo/b3daf48a-3dec-4d36-970e-f8173c7a0baa/data/default/testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,531 INFO [Listener at localhost/39309] snapshot.RestoreSnapshotHelper(239): region to add: dc2d5929f9026c392ba14cee329e1693 2023-02-16 18:01:33,531 INFO [Listener at localhost/39309] snapshot.RestoreSnapshotHelper(585): clone region=dc2d5929f9026c392ba14cee329e1693 as dc2d5929f9026c392ba14cee329e1693 in snapshot foo 2023-02-16 18:01:33,532 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => dc2d5929f9026c392ba14cee329e1693, NAME => 'testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42551/user/jenkins/test-data/9e945780-56f7-6df0-3aa5-9060846ea363/foo/b3daf48a-3dec-4d36-970e-f8173c7a0baa 2023-02-16 18:01:33,538 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:33,538 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7a394c374dc442d39832518d2412a5e3 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,540 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink cb5a38990d9d42de8fc583e08fb3a3f7 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,542 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing dc2d5929f9026c392ba14cee329e1693, disabling compactions & flushes 2023-02-16 18:01:33,542 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693. 2023-02-16 18:01:33,542 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693. 2023-02-16 18:01:33,542 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693. after waiting 0 ms 2023-02-16 18:01:33,542 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693. 2023-02-16 18:01:33,542 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693. 2023-02-16 18:01:33,542 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for dc2d5929f9026c392ba14cee329e1693: 2023-02-16 18:01:33,542 INFO [Listener at localhost/39309] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676570492830 type: FLUSH version: 2 ttl: 0 2023-02-16 18:01:33,543 DEBUG [Listener at localhost/39309] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:42551/user/jenkins/test-data/9e945780-56f7-6df0-3aa5-9060846ea363/foo/b3daf48a-3dec-4d36-970e-f8173c7a0baa 2023-02-16 18:01:33,543 DEBUG [Listener at localhost/39309] util.CommonFSUtils(682): File system contents for path hdfs://localhost:42551/user/jenkins/test-data/9e945780-56f7-6df0-3aa5-9060846ea363/foo/b3daf48a-3dec-4d36-970e-f8173c7a0baa 2023-02-16 18:01:33,543 DEBUG [Listener at localhost/39309] util.CommonFSUtils(699): |-data/ 2023-02-16 18:01:33,543 DEBUG [Listener at localhost/39309] util.CommonFSUtils(699): |----default/ 2023-02-16 18:01:33,544 DEBUG [Listener at localhost/39309] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-16 18:01:33,544 DEBUG [Listener at localhost/39309] util.CommonFSUtils(699): |----------dc2d5929f9026c392ba14cee329e1693/ 2023-02-16 18:01:33,545 DEBUG [Listener at localhost/39309] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 18:01:33,545 DEBUG [Listener at localhost/39309] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 18:01:33,545 DEBUG [Listener at localhost/39309] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=dc2d5929f9026c392ba14cee329e1693-7a394c374dc442d39832518d2412a5e3 2023-02-16 18:01:33,545 DEBUG [Listener at localhost/39309] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 18:01:33,545 DEBUG [Listener at localhost/39309] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=dc2d5929f9026c392ba14cee329e1693-cb5a38990d9d42de8fc583e08fb3a3f7 2023-02-16 18:01:33,547 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-16 18:01:33,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-16 18:01:33,549 INFO [Listener at localhost/39309] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,550 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 18:01:33,553 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676570493553"}]},"ts":"1676570493553"} 2023-02-16 18:01:33,554 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-16 18:01:33,555 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-16 18:01:33,556 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=dc2d5929f9026c392ba14cee329e1693, UNASSIGN}] 2023-02-16 18:01:33,558 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=dc2d5929f9026c392ba14cee329e1693, UNASSIGN 2023-02-16 18:01:33,558 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=dc2d5929f9026c392ba14cee329e1693, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:33,558 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676570493558"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570493558"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570493558"}]},"ts":"1676570493558"} 2023-02-16 18:01:33,559 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure dc2d5929f9026c392ba14cee329e1693, server=jenkins-hbase4.apache.org,38535,1676570490293}] 2023-02-16 18:01:33,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 18:01:33,711 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close dc2d5929f9026c392ba14cee329e1693 2023-02-16 18:01:33,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing dc2d5929f9026c392ba14cee329e1693, disabling compactions & flushes 2023-02-16 18:01:33,712 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693. 2023-02-16 18:01:33,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693. 2023-02-16 18:01:33,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693. after waiting 0 ms 2023-02-16 18:01:33,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693. 2023-02-16 18:01:33,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 18:01:33,716 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693. 2023-02-16 18:01:33,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for dc2d5929f9026c392ba14cee329e1693: 2023-02-16 18:01:33,717 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed dc2d5929f9026c392ba14cee329e1693 2023-02-16 18:01:33,718 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=dc2d5929f9026c392ba14cee329e1693, regionState=CLOSED 2023-02-16 18:01:33,718 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676570493718"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570493718"}]},"ts":"1676570493718"} 2023-02-16 18:01:33,720 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-16 18:01:33,720 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure dc2d5929f9026c392ba14cee329e1693, server=jenkins-hbase4.apache.org,38535,1676570490293 in 160 msec 2023-02-16 18:01:33,721 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-16 18:01:33,722 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=dc2d5929f9026c392ba14cee329e1693, UNASSIGN in 164 msec 2023-02-16 18:01:33,722 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676570493722"}]},"ts":"1676570493722"} 2023-02-16 18:01:33,723 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-16 18:01:33,726 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-16 18:01:33,727 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 176 msec 2023-02-16 18:01:33,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 18:01:33,856 INFO [Listener at localhost/39309] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-16 18:01:33,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,859 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,860 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-16 18:01:33,863 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/.tmp/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693 2023-02-16 18:01:33,864 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/.tmp/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693/f1, FileablePath, hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/.tmp/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693/f2, FileablePath, hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/.tmp/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693/recovered.edits] 2023-02-16 18:01:33,868 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/.tmp/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693/f1/308813292f0b4948a5bda70e3fa2ba71 to hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/archive/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693/f1/308813292f0b4948a5bda70e3fa2ba71 2023-02-16 18:01:33,869 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/.tmp/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693/f1/7a394c374dc442d39832518d2412a5e3 to hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/archive/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693/f1/7a394c374dc442d39832518d2412a5e3 2023-02-16 18:01:33,871 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/.tmp/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693/f2/26746f0c32e740ef8575c7e294ddf144 to hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/archive/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693/f2/26746f0c32e740ef8575c7e294ddf144 2023-02-16 18:01:33,872 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/.tmp/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693/f2/cb5a38990d9d42de8fc583e08fb3a3f7 to hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/archive/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693/f2/cb5a38990d9d42de8fc583e08fb3a3f7 2023-02-16 18:01:33,874 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/.tmp/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693/recovered.edits/12.seqid to hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/archive/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693/recovered.edits/12.seqid 2023-02-16 18:01:33,875 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/.tmp/data/default/testInitTableSnapshotMapperJobConfig/dc2d5929f9026c392ba14cee329e1693 2023-02-16 18:01:33,875 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-16 18:01:33,876 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,878 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-16 18:01:33,879 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-16 18:01:33,880 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,880 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-16 18:01:33,880 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676570493880"}]},"ts":"9223372036854775807"} 2023-02-16 18:01:33,882 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-16 18:01:33,882 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => dc2d5929f9026c392ba14cee329e1693, NAME => 'testInitTableSnapshotMapperJobConfig,,1676570491656.dc2d5929f9026c392ba14cee329e1693.', STARTKEY => '', ENDKEY => ''}] 2023-02-16 18:01:33,882 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-16 18:01:33,882 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676570493882"}]},"ts":"9223372036854775807"} 2023-02-16 18:01:33,885 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-16 18:01:33,887 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-16 18:01:33,888 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 30 msec 2023-02-16 18:01:33,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37139] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-16 18:01:33,962 INFO [Listener at localhost/39309] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-16 18:01:33,962 INFO [Listener at localhost/39309] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-16 18:01:33,962 INFO [Listener at localhost/39309] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-16 18:01:33,962 DEBUG [Listener at localhost/39309] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5fc685f7 to 127.0.0.1:50324 2023-02-16 18:01:33,962 DEBUG [Listener at localhost/39309] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:33,962 DEBUG [Listener at localhost/39309] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-16 18:01:33,962 DEBUG [Listener at localhost/39309] util.JVMClusterUtil(257): Found active master hash=646503374, stopped=false 2023-02-16 18:01:33,962 INFO [Listener at localhost/39309] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,37139,1676570490190 2023-02-16 18:01:33,964 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:38535-0x1005e4b5f010002, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:33,964 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:33,964 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:35157-0x1005e4b5f010001, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:33,965 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:33,965 INFO [Listener at localhost/39309] procedure2.ProcedureExecutor(629): Stopping 2023-02-16 18:01:33,965 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38535-0x1005e4b5f010002, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:33,965 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:33,966 DEBUG [Listener at localhost/39309] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3952cd29 to 127.0.0.1:50324 2023-02-16 18:01:33,966 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35157-0x1005e4b5f010001, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:33,966 DEBUG [Listener at localhost/39309] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:33,967 INFO [Listener at localhost/39309] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35157,1676570490234' ***** 2023-02-16 18:01:33,967 INFO [Listener at localhost/39309] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 18:01:33,967 INFO [Listener at localhost/39309] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38535,1676570490293' ***** 2023-02-16 18:01:33,967 INFO [Listener at localhost/39309] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 18:01:33,967 INFO [RS:1;jenkins-hbase4:38535] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 18:01:33,967 INFO [RS:0;jenkins-hbase4:35157] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 18:01:33,967 INFO [RS:1;jenkins-hbase4:38535] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 18:01:33,967 INFO [RS:0;jenkins-hbase4:35157] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 18:01:33,967 INFO [RS:1;jenkins-hbase4:38535] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 18:01:33,967 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 18:01:33,967 INFO [RS:1;jenkins-hbase4:38535] regionserver.HRegionServer(3304): Received CLOSE for 34d583c11c27e63a50cd3e30b0a3fa21 2023-02-16 18:01:33,967 INFO [RS:0;jenkins-hbase4:35157] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 18:01:33,968 INFO [RS:0;jenkins-hbase4:35157] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35157,1676570490234 2023-02-16 18:01:33,969 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 34d583c11c27e63a50cd3e30b0a3fa21, disabling compactions & flushes 2023-02-16 18:01:33,967 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 18:01:33,969 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676570491016.34d583c11c27e63a50cd3e30b0a3fa21. 2023-02-16 18:01:33,969 DEBUG [RS:0;jenkins-hbase4:35157] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x103d4457 to 127.0.0.1:50324 2023-02-16 18:01:33,968 INFO [RS:1;jenkins-hbase4:38535] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:33,970 DEBUG [RS:0;jenkins-hbase4:35157] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:33,969 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676570491016.34d583c11c27e63a50cd3e30b0a3fa21. 2023-02-16 18:01:33,970 INFO [RS:0;jenkins-hbase4:35157] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35157,1676570490234; all regions closed. 2023-02-16 18:01:33,970 DEBUG [RS:1;jenkins-hbase4:38535] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0eb8d8dc to 127.0.0.1:50324 2023-02-16 18:01:33,970 DEBUG [RS:1;jenkins-hbase4:38535] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:33,970 INFO [RS:1;jenkins-hbase4:38535] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 18:01:33,970 INFO [RS:1;jenkins-hbase4:38535] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 18:01:33,970 INFO [RS:1;jenkins-hbase4:38535] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 18:01:33,970 INFO [RS:1;jenkins-hbase4:38535] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-16 18:01:33,970 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676570491016.34d583c11c27e63a50cd3e30b0a3fa21. after waiting 0 ms 2023-02-16 18:01:33,970 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676570491016.34d583c11c27e63a50cd3e30b0a3fa21. 2023-02-16 18:01:33,970 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 34d583c11c27e63a50cd3e30b0a3fa21 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-16 18:01:33,980 INFO [RS:1;jenkins-hbase4:38535] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-16 18:01:33,980 DEBUG [RS:1;jenkins-hbase4:38535] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 34d583c11c27e63a50cd3e30b0a3fa21=hbase:namespace,,1676570491016.34d583c11c27e63a50cd3e30b0a3fa21.} 2023-02-16 18:01:33,981 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 18:01:33,981 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 18:01:33,981 DEBUG [RS:1;jenkins-hbase4:38535] regionserver.HRegionServer(1505): Waiting on 1588230740, 34d583c11c27e63a50cd3e30b0a3fa21 2023-02-16 18:01:33,981 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 18:01:33,982 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 18:01:33,982 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 18:01:33,982 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-16 18:01:33,985 DEBUG [RS:0;jenkins-hbase4:35157] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/oldWALs 2023-02-16 18:01:33,985 INFO [RS:0;jenkins-hbase4:35157] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35157%2C1676570490234:(num 1676570491647) 2023-02-16 18:01:33,985 DEBUG [RS:0;jenkins-hbase4:35157] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:33,986 INFO [RS:0;jenkins-hbase4:35157] regionserver.LeaseManager(133): Closed leases 2023-02-16 18:01:33,986 INFO [RS:0;jenkins-hbase4:35157] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-16 18:01:33,986 INFO [RS:0;jenkins-hbase4:35157] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 18:01:33,986 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 18:01:33,986 INFO [RS:0;jenkins-hbase4:35157] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 18:01:33,986 INFO [RS:0;jenkins-hbase4:35157] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 18:01:33,987 INFO [RS:0;jenkins-hbase4:35157] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35157 2023-02-16 18:01:33,989 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:38535-0x1005e4b5f010002, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35157,1676570490234 2023-02-16 18:01:33,989 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:38535-0x1005e4b5f010002, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:33,989 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:33,989 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:35157-0x1005e4b5f010001, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35157,1676570490234 2023-02-16 18:01:33,989 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35157,1676570490234] 2023-02-16 18:01:33,989 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35157,1676570490234; numProcessing=1 2023-02-16 18:01:33,991 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35157,1676570490234 already deleted, retry=false 2023-02-16 18:01:33,991 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35157,1676570490234 expired; onlineServers=1 2023-02-16 18:01:33,994 ERROR [Listener at localhost/39309-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@315d6ba6 rejected from java.util.concurrent.ThreadPoolExecutor@3562f955[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:33,995 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:35157-0x1005e4b5f010001, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:33,995 ERROR [Listener at localhost/39309-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1b80ce0e rejected from java.util.concurrent.ThreadPoolExecutor@3562f955[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:34,000 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/hbase/namespace/34d583c11c27e63a50cd3e30b0a3fa21/.tmp/info/b1b824ee70104c6e95e9bf3dc3c4fdba 2023-02-16 18:01:34,003 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/hbase/meta/1588230740/.tmp/info/9e3b3a5089294a3d8fed0677cf15ec71 2023-02-16 18:01:34,005 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/hbase/namespace/34d583c11c27e63a50cd3e30b0a3fa21/.tmp/info/b1b824ee70104c6e95e9bf3dc3c4fdba as hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/hbase/namespace/34d583c11c27e63a50cd3e30b0a3fa21/info/b1b824ee70104c6e95e9bf3dc3c4fdba 2023-02-16 18:01:34,007 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9e3b3a5089294a3d8fed0677cf15ec71 2023-02-16 18:01:34,011 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/hbase/namespace/34d583c11c27e63a50cd3e30b0a3fa21/info/b1b824ee70104c6e95e9bf3dc3c4fdba, entries=2, sequenceid=6, filesize=4.8 K 2023-02-16 18:01:34,012 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 34d583c11c27e63a50cd3e30b0a3fa21 in 42ms, sequenceid=6, compaction requested=false 2023-02-16 18:01:34,016 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/hbase/namespace/34d583c11c27e63a50cd3e30b0a3fa21/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-16 18:01:34,017 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/hbase/meta/1588230740/.tmp/rep_barrier/bb9140457c7445c7944140f6a4570bfb 2023-02-16 18:01:34,017 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676570491016.34d583c11c27e63a50cd3e30b0a3fa21. 2023-02-16 18:01:34,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 34d583c11c27e63a50cd3e30b0a3fa21: 2023-02-16 18:01:34,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676570491016.34d583c11c27e63a50cd3e30b0a3fa21. 2023-02-16 18:01:34,020 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bb9140457c7445c7944140f6a4570bfb 2023-02-16 18:01:34,025 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 18:01:34,028 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/hbase/meta/1588230740/.tmp/table/f9c2ab7bab004b929ed337459c6fc1d0 2023-02-16 18:01:34,031 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f9c2ab7bab004b929ed337459c6fc1d0 2023-02-16 18:01:34,032 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/hbase/meta/1588230740/.tmp/info/9e3b3a5089294a3d8fed0677cf15ec71 as hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/hbase/meta/1588230740/info/9e3b3a5089294a3d8fed0677cf15ec71 2023-02-16 18:01:34,035 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9e3b3a5089294a3d8fed0677cf15ec71 2023-02-16 18:01:34,035 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/hbase/meta/1588230740/info/9e3b3a5089294a3d8fed0677cf15ec71, entries=12, sequenceid=21, filesize=6.3 K 2023-02-16 18:01:34,036 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/hbase/meta/1588230740/.tmp/rep_barrier/bb9140457c7445c7944140f6a4570bfb as hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/hbase/meta/1588230740/rep_barrier/bb9140457c7445c7944140f6a4570bfb 2023-02-16 18:01:34,038 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 18:01:34,040 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bb9140457c7445c7944140f6a4570bfb 2023-02-16 18:01:34,040 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/hbase/meta/1588230740/rep_barrier/bb9140457c7445c7944140f6a4570bfb, entries=1, sequenceid=21, filesize=5.0 K 2023-02-16 18:01:34,041 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/hbase/meta/1588230740/.tmp/table/f9c2ab7bab004b929ed337459c6fc1d0 as hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/hbase/meta/1588230740/table/f9c2ab7bab004b929ed337459c6fc1d0 2023-02-16 18:01:34,045 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f9c2ab7bab004b929ed337459c6fc1d0 2023-02-16 18:01:34,045 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/hbase/meta/1588230740/table/f9c2ab7bab004b929ed337459c6fc1d0, entries=4, sequenceid=21, filesize=5.1 K 2023-02-16 18:01:34,046 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 64ms, sequenceid=21, compaction requested=false 2023-02-16 18:01:34,049 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-16 18:01:34,049 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 18:01:34,050 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 18:01:34,050 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 18:01:34,050 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-16 18:01:34,165 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:35157-0x1005e4b5f010001, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:34,165 INFO [RS:0;jenkins-hbase4:35157] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35157,1676570490234; zookeeper connection closed. 2023-02-16 18:01:34,165 ERROR [Listener at localhost/39309-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@63d067bc rejected from java.util.concurrent.ThreadPoolExecutor@3562f955[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:34,165 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:35157-0x1005e4b5f010001, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:34,165 ERROR [Listener at localhost/39309-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@da2d26b rejected from java.util.concurrent.ThreadPoolExecutor@3562f955[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:34,165 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3f3c073a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3f3c073a 2023-02-16 18:01:34,182 INFO [RS:1;jenkins-hbase4:38535] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38535,1676570490293; all regions closed. 2023-02-16 18:01:34,187 DEBUG [RS:1;jenkins-hbase4:38535] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/oldWALs 2023-02-16 18:01:34,187 INFO [RS:1;jenkins-hbase4:38535] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38535%2C1676570490293.meta:.meta(num 1676570490953) 2023-02-16 18:01:34,192 DEBUG [RS:1;jenkins-hbase4:38535] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/oldWALs 2023-02-16 18:01:34,192 INFO [RS:1;jenkins-hbase4:38535] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38535%2C1676570490293:(num 1676570491389) 2023-02-16 18:01:34,192 DEBUG [RS:1;jenkins-hbase4:38535] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:34,193 INFO [RS:1;jenkins-hbase4:38535] regionserver.LeaseManager(133): Closed leases 2023-02-16 18:01:34,193 INFO [RS:1;jenkins-hbase4:38535] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-16 18:01:34,193 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 18:01:34,194 INFO [RS:1;jenkins-hbase4:38535] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38535 2023-02-16 18:01:34,195 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:38535-0x1005e4b5f010002, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38535,1676570490293 2023-02-16 18:01:34,196 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:34,196 ERROR [Listener at localhost/39309-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6524b276 rejected from java.util.concurrent.ThreadPoolExecutor@611b3a0a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:34,197 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38535,1676570490293] 2023-02-16 18:01:34,197 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38535,1676570490293; numProcessing=2 2023-02-16 18:01:34,199 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38535,1676570490293 already deleted, retry=false 2023-02-16 18:01:34,199 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38535,1676570490293 expired; onlineServers=0 2023-02-16 18:01:34,199 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37139,1676570490190' ***** 2023-02-16 18:01:34,199 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-16 18:01:34,200 DEBUG [M:0;jenkins-hbase4:37139] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22b74bc7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 18:01:34,200 INFO [M:0;jenkins-hbase4:37139] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37139,1676570490190 2023-02-16 18:01:34,200 INFO [M:0;jenkins-hbase4:37139] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37139,1676570490190; all regions closed. 2023-02-16 18:01:34,200 DEBUG [M:0;jenkins-hbase4:37139] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:34,200 DEBUG [M:0;jenkins-hbase4:37139] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-16 18:01:34,200 DEBUG [M:0;jenkins-hbase4:37139] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-16 18:01:34,200 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-16 18:01:34,201 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676570490514] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676570490514,5,FailOnTimeoutGroup] 2023-02-16 18:01:34,201 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676570490514] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676570490514,5,FailOnTimeoutGroup] 2023-02-16 18:01:34,201 INFO [M:0;jenkins-hbase4:37139] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-16 18:01:34,202 INFO [M:0;jenkins-hbase4:37139] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-16 18:01:34,202 INFO [M:0;jenkins-hbase4:37139] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-16 18:01:34,202 DEBUG [M:0;jenkins-hbase4:37139] master.HMaster(1512): Stopping service threads 2023-02-16 18:01:34,202 INFO [M:0;jenkins-hbase4:37139] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-16 18:01:34,203 ERROR [M:0;jenkins-hbase4:37139] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-16 18:01:34,203 INFO [M:0;jenkins-hbase4:37139] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-16 18:01:34,203 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-16 18:01:34,206 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-16 18:01:34,206 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:34,206 DEBUG [M:0;jenkins-hbase4:37139] zookeeper.RecoverableZooKeeper(172): Node /hbase/master already deleted, retry=false 2023-02-16 18:01:34,206 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 18:01:34,206 DEBUG [M:0;jenkins-hbase4:37139] master.ActiveMasterManager(335): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Failed delete of our master address node; KeeperErrorCode = NoNode for /hbase/master 2023-02-16 18:01:34,206 INFO [M:0;jenkins-hbase4:37139] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-16 18:01:34,207 INFO [M:0;jenkins-hbase4:37139] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-16 18:01:34,208 DEBUG [M:0;jenkins-hbase4:37139] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 18:01:34,208 INFO [M:0;jenkins-hbase4:37139] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:34,208 DEBUG [M:0;jenkins-hbase4:37139] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:34,208 DEBUG [M:0;jenkins-hbase4:37139] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 18:01:34,208 DEBUG [M:0;jenkins-hbase4:37139] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:34,208 INFO [M:0;jenkins-hbase4:37139] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.91 KB heapSize=66.88 KB 2023-02-16 18:01:34,222 INFO [M:0;jenkins-hbase4:37139] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.91 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f9a4aa2a766942a6a6022f87b9585b70 2023-02-16 18:01:34,226 DEBUG [M:0;jenkins-hbase4:37139] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f9a4aa2a766942a6a6022f87b9585b70 as hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f9a4aa2a766942a6a6022f87b9585b70 2023-02-16 18:01:34,230 INFO [M:0;jenkins-hbase4:37139] regionserver.HStore(1080): Added hdfs://localhost:42551/user/jenkins/test-data/0f6d5f7d-79b3-3891-4df3-ea9f3f675bbc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f9a4aa2a766942a6a6022f87b9585b70, entries=17, sequenceid=132, filesize=8.7 K 2023-02-16 18:01:34,231 INFO [M:0;jenkins-hbase4:37139] regionserver.HRegion(2947): Finished flush of dataSize ~55.91 KB/57251, heapSize ~66.86 KB/68464, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 23ms, sequenceid=132, compaction requested=false 2023-02-16 18:01:34,231 INFO [M:0;jenkins-hbase4:37139] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:34,231 DEBUG [M:0;jenkins-hbase4:37139] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 18:01:34,236 INFO [M:0;jenkins-hbase4:37139] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-16 18:01:34,236 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 18:01:34,237 INFO [M:0;jenkins-hbase4:37139] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37139 2023-02-16 18:01:34,239 DEBUG [M:0;jenkins-hbase4:37139] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,37139,1676570490190 already deleted, retry=false 2023-02-16 18:01:34,565 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:34,565 INFO [M:0;jenkins-hbase4:37139] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37139,1676570490190; zookeeper connection closed. 2023-02-16 18:01:34,565 ERROR [Listener at localhost/39309-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@736c393 rejected from java.util.concurrent.ThreadPoolExecutor@30957ad[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:34,566 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): master:37139-0x1005e4b5f010000, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:34,566 ERROR [Listener at localhost/39309-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@469c1260 rejected from java.util.concurrent.ThreadPoolExecutor@30957ad[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:34,665 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:38535-0x1005e4b5f010002, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:34,665 INFO [RS:1;jenkins-hbase4:38535] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38535,1676570490293; zookeeper connection closed. 2023-02-16 18:01:34,665 ERROR [Listener at localhost/39309-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@55805535 rejected from java.util.concurrent.ThreadPoolExecutor@611b3a0a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:34,665 DEBUG [Listener at localhost/39309-EventThread] zookeeper.ZKWatcher(600): regionserver:38535-0x1005e4b5f010002, quorum=127.0.0.1:50324, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:34,665 ERROR [Listener at localhost/39309-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2d04493f rejected from java.util.concurrent.ThreadPoolExecutor@611b3a0a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:34,665 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@358edb86] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@358edb86 2023-02-16 18:01:34,666 INFO [Listener at localhost/39309] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-16 18:01:34,666 WARN [Listener at localhost/39309] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 18:01:34,673 INFO [Listener at localhost/39309] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 18:01:34,778 WARN [BP-239017197-172.31.14.131-1676570489629 heartbeating to localhost/127.0.0.1:42551] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 18:01:34,778 WARN [BP-239017197-172.31.14.131-1676570489629 heartbeating to localhost/127.0.0.1:42551] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-239017197-172.31.14.131-1676570489629 (Datanode Uuid 0f517380-fc7a-477e-9940-5e583b596645) service to localhost/127.0.0.1:42551 2023-02-16 18:01:34,780 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddc7f974-af72-3876-7395-ffee8c477e01/cluster_b24ec5f3-ba47-8918-9587-2d9c9116d949/dfs/data/data3/current/BP-239017197-172.31.14.131-1676570489629] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 18:01:34,781 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddc7f974-af72-3876-7395-ffee8c477e01/cluster_b24ec5f3-ba47-8918-9587-2d9c9116d949/dfs/data/data4/current/BP-239017197-172.31.14.131-1676570489629] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 18:01:34,783 WARN [Listener at localhost/39309] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 18:01:34,786 INFO [Listener at localhost/39309] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 18:01:34,892 WARN [BP-239017197-172.31.14.131-1676570489629 heartbeating to localhost/127.0.0.1:42551] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 18:01:34,892 WARN [BP-239017197-172.31.14.131-1676570489629 heartbeating to localhost/127.0.0.1:42551] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-239017197-172.31.14.131-1676570489629 (Datanode Uuid 3581c93b-0176-4c27-980d-97d274d7d984) service to localhost/127.0.0.1:42551 2023-02-16 18:01:34,893 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddc7f974-af72-3876-7395-ffee8c477e01/cluster_b24ec5f3-ba47-8918-9587-2d9c9116d949/dfs/data/data1/current/BP-239017197-172.31.14.131-1676570489629] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 18:01:34,893 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddc7f974-af72-3876-7395-ffee8c477e01/cluster_b24ec5f3-ba47-8918-9587-2d9c9116d949/dfs/data/data2/current/BP-239017197-172.31.14.131-1676570489629] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 18:01:34,903 INFO [Listener at localhost/39309] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 18:01:34,955 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 18:01:35,017 INFO [Listener at localhost/39309] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-16 18:01:35,040 INFO [Listener at localhost/39309] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-16 18:01:35,055 INFO [Listener at localhost/39309] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=178 (was 154) Potentially hanging thread: (jenkins-hbase4.apache.org,37139,1676570490190)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1124632911) connection to localhost/127.0.0.1:42551 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1124632911) connection to localhost/127.0.0.1:42551 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:42551 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1124632911) connection to localhost/127.0.0.1:42551 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/39309 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1124632911) connection to localhost/127.0.0.1:42551 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost:42551 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost:42551 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=571 (was 537) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=296 (was 313), ProcessCount=170 (was 170), AvailableMemoryMB=1385 (was 1441) 2023-02-16 18:01:35,067 INFO [Listener at localhost/39309] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=178, OpenFileDescriptor=571, MaxFileDescriptor=60000, SystemLoadAverage=296, ProcessCount=170, AvailableMemoryMB=1385 2023-02-16 18:01:35,080 INFO [Listener at localhost/39309] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddc7f974-af72-3876-7395-ffee8c477e01/hadoop.log.dir so I do NOT create it in target/test-data/661ccbb0-5b8f-013c-bd3e-089e158f2c8e 2023-02-16 18:01:35,080 WARN [Listener at localhost/39309] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddc7f974-af72-3876-7395-ffee8c477e01/hadoop.log.dir Erasing configuration value by system value. 2023-02-16 18:01:35,080 INFO [Listener at localhost/39309] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddc7f974-af72-3876-7395-ffee8c477e01/hadoop.tmp.dir so I do NOT create it in target/test-data/661ccbb0-5b8f-013c-bd3e-089e158f2c8e 2023-02-16 18:01:35,080 WARN [Listener at localhost/39309] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddc7f974-af72-3876-7395-ffee8c477e01/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-16 18:01:35,080 DEBUG [Listener at localhost/39309] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/661ccbb0-5b8f-013c-bd3e-089e158f2c8e 2023-02-16 18:01:35,081 INFO [Listener at localhost/39309] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-16 18:01:35,081 INFO [Listener at localhost/39309] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/661ccbb0-5b8f-013c-bd3e-089e158f2c8e/cluster_9e9909f0-0933-c29b-2a4a-ccd4da4decaf, deleteOnExit=true 2023-02-16 18:01:35,081 INFO [Listener at localhost/39309] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-16 18:01:35,081 INFO [Listener at localhost/39309] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/661ccbb0-5b8f-013c-bd3e-089e158f2c8e/test.cache.data in system properties and HBase conf 2023-02-16 18:01:35,081 INFO [Listener at localhost/39309] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/661ccbb0-5b8f-013c-bd3e-089e158f2c8e/hadoop.tmp.dir in system properties and HBase conf 2023-02-16 18:01:35,081 INFO [Listener at localhost/39309] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/661ccbb0-5b8f-013c-bd3e-089e158f2c8e/hadoop.log.dir in system properties and HBase conf 2023-02-16 18:01:35,082 INFO [Listener at localhost/39309] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/661ccbb0-5b8f-013c-bd3e-089e158f2c8e/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-16 18:01:35,082 INFO [Listener at localhost/39309] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/661ccbb0-5b8f-013c-bd3e-089e158f2c8e/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-16 18:01:35,082 INFO [Listener at localhost/39309] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-16 18:01:35,082 DEBUG [Listener at localhost/39309] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-16 18:01:35,082 INFO [Listener at localhost/39309] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/661ccbb0-5b8f-013c-bd3e-089e158f2c8e/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-16 18:01:35,082 INFO [Listener at localhost/39309] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/661ccbb0-5b8f-013c-bd3e-089e158f2c8e/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-16 18:01:35,082 INFO [Listener at localhost/39309] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/661ccbb0-5b8f-013c-bd3e-089e158f2c8e/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-16 18:01:35,083 INFO [Listener at localhost/39309] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/661ccbb0-5b8f-013c-bd3e-089e158f2c8e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 18:01:35,083 INFO [Listener at localhost/39309] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/661ccbb0-5b8f-013c-bd3e-089e158f2c8e/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-16 18:01:35,083 INFO [Listener at localhost/39309] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/661ccbb0-5b8f-013c-bd3e-089e158f2c8e/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-16 18:01:35,083 INFO [Listener at localhost/39309] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/661ccbb0-5b8f-013c-bd3e-089e158f2c8e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 18:01:35,083 INFO [Listener at localhost/39309] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/661ccbb0-5b8f-013c-bd3e-089e158f2c8e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 18:01:35,083 INFO [Listener at localhost/39309] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/661ccbb0-5b8f-013c-bd3e-089e158f2c8e/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-16 18:01:35,083 INFO [Listener at localhost/39309] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/661ccbb0-5b8f-013c-bd3e-089e158f2c8e/nfs.dump.dir in system properties and HBase conf 2023-02-16 18:01:35,083 INFO [Listener at localhost/39309] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/661ccbb0-5b8f-013c-bd3e-089e158f2c8e/java.io.tmpdir in system properties and HBase conf 2023-02-16 18:01:35,084 INFO [Listener at localhost/39309] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/661ccbb0-5b8f-013c-bd3e-089e158f2c8e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 18:01:35,084 INFO [Listener at localhost/39309] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/661ccbb0-5b8f-013c-bd3e-089e158f2c8e/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-16 18:01:35,084 INFO [Listener at localhost/39309] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/661ccbb0-5b8f-013c-bd3e-089e158f2c8e/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-16 18:01:35,089 WARN [Listener at localhost/39309] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 18:01:35,089 WARN [Listener at localhost/39309] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 18:01:35,140 WARN [Listener at localhost/39309] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 18:01:35,143 INFO [Listener at localhost/39309] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 18:01:35,153 INFO [Listener at localhost/39309] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/661ccbb0-5b8f-013c-bd3e-089e158f2c8e/java.io.tmpdir/Jetty_localhost_43021_hdfs____ekek3e/webapp 2023-02-16 18:01:35,257 INFO [Listener at localhost/39309] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43021 2023-02-16 18:01:35,261 WARN [Listener at localhost/39309] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 18:01:35,261 WARN [Listener at localhost/39309] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 18:01:35,306 WARN [Listener at localhost/40013] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 18:01:35,316 WARN [Listener at localhost/40013] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 18:01:35,318 WARN [Listener at localhost/40013] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 18:01:35,319 INFO [Listener at localhost/40013] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 18:01:35,324 INFO [Listener at localhost/40013] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/661ccbb0-5b8f-013c-bd3e-089e158f2c8e/java.io.tmpdir/Jetty_localhost_46195_datanode____tynws2/webapp 2023-02-16 18:01:35,432 INFO [Listener at localhost/40013] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46195 2023-02-16 18:01:35,464 WARN [Listener at localhost/34095] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 18:01:35,497 WARN [Listener at localhost/34095] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 18:01:35,500 WARN [Listener at localhost/34095] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 18:01:35,501 INFO [Listener at localhost/34095] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 18:01:35,507 INFO [Listener at localhost/34095] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/661ccbb0-5b8f-013c-bd3e-089e158f2c8e/java.io.tmpdir/Jetty_localhost_35323_datanode____.7xv8xz/webapp 2023-02-16 18:01:35,602 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3ca8de996c91a1e2: Processing first storage report for DS-e007f06d-9eba-4bd3-adfe-550d062a15cf from datanode 6f163c0e-00e6-470e-8586-4840f027debf 2023-02-16 18:01:35,602 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3ca8de996c91a1e2: from storage DS-e007f06d-9eba-4bd3-adfe-550d062a15cf node DatanodeRegistration(127.0.0.1:34331, datanodeUuid=6f163c0e-00e6-470e-8586-4840f027debf, infoPort=44947, infoSecurePort=0, ipcPort=34095, storageInfo=lv=-57;cid=testClusterID;nsid=1054162965;c=1676570495091), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-16 18:01:35,602 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3ca8de996c91a1e2: Processing first storage report for DS-8c685659-98ac-436a-87d7-49bb8086be3d from datanode 6f163c0e-00e6-470e-8586-4840f027debf 2023-02-16 18:01:35,602 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3ca8de996c91a1e2: from storage DS-8c685659-98ac-436a-87d7-49bb8086be3d node DatanodeRegistration(127.0.0.1:34331, datanodeUuid=6f163c0e-00e6-470e-8586-4840f027debf, infoPort=44947, infoSecurePort=0, ipcPort=34095, storageInfo=lv=-57;cid=testClusterID;nsid=1054162965;c=1676570495091), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 18:01:35,629 INFO [Listener at localhost/34095] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35323 2023-02-16 18:01:35,636 WARN [Listener at localhost/34831] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 18:01:35,730 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x53e1f9b675d9a174: Processing first storage report for DS-a1f3bca0-cb2a-47ad-a37e-08ab5c015bcf from datanode 54fd46bd-9ace-4eb2-b83c-34e8b538a34b 2023-02-16 18:01:35,731 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x53e1f9b675d9a174: from storage DS-a1f3bca0-cb2a-47ad-a37e-08ab5c015bcf node DatanodeRegistration(127.0.0.1:44633, datanodeUuid=54fd46bd-9ace-4eb2-b83c-34e8b538a34b, infoPort=39837, infoSecurePort=0, ipcPort=34831, storageInfo=lv=-57;cid=testClusterID;nsid=1054162965;c=1676570495091), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 18:01:35,731 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x53e1f9b675d9a174: Processing first storage report for DS-97a3c2c0-ebc9-43df-917c-bef98bf1a554 from datanode 54fd46bd-9ace-4eb2-b83c-34e8b538a34b 2023-02-16 18:01:35,731 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x53e1f9b675d9a174: from storage DS-97a3c2c0-ebc9-43df-917c-bef98bf1a554 node DatanodeRegistration(127.0.0.1:44633, datanodeUuid=54fd46bd-9ace-4eb2-b83c-34e8b538a34b, infoPort=39837, infoSecurePort=0, ipcPort=34831, storageInfo=lv=-57;cid=testClusterID;nsid=1054162965;c=1676570495091), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 18:01:35,747 DEBUG [Listener at localhost/34831] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/661ccbb0-5b8f-013c-bd3e-089e158f2c8e 2023-02-16 18:01:35,755 INFO [Listener at localhost/34831] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/661ccbb0-5b8f-013c-bd3e-089e158f2c8e/cluster_9e9909f0-0933-c29b-2a4a-ccd4da4decaf/zookeeper_0, clientPort=54761, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/661ccbb0-5b8f-013c-bd3e-089e158f2c8e/cluster_9e9909f0-0933-c29b-2a4a-ccd4da4decaf/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/661ccbb0-5b8f-013c-bd3e-089e158f2c8e/cluster_9e9909f0-0933-c29b-2a4a-ccd4da4decaf/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-16 18:01:35,756 INFO [Listener at localhost/34831] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=54761 2023-02-16 18:01:35,756 INFO [Listener at localhost/34831] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:35,757 INFO [Listener at localhost/34831] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:35,783 INFO [Listener at localhost/34831] util.FSUtils(479): Created version file at hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee with version=8 2023-02-16 18:01:35,783 INFO [Listener at localhost/34831] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:35,785 INFO [Listener at localhost/34831] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:35,786 INFO [Listener at localhost/34831] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/hbase-staging 2023-02-16 18:01:35,788 INFO [Listener at localhost/34831] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 18:01:35,789 INFO [Listener at localhost/34831] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:35,789 INFO [Listener at localhost/34831] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:35,789 INFO [Listener at localhost/34831] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 18:01:35,789 INFO [Listener at localhost/34831] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:35,789 INFO [Listener at localhost/34831] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 18:01:35,789 INFO [Listener at localhost/34831] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 18:01:35,791 INFO [Listener at localhost/34831] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36327 2023-02-16 18:01:35,791 INFO [Listener at localhost/34831] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:35,792 INFO [Listener at localhost/34831] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:35,793 INFO [Listener at localhost/34831] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36327 connecting to ZooKeeper ensemble=127.0.0.1:54761 2023-02-16 18:01:35,803 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:363270x0, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 18:01:35,804 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:36327-0x1005e4b74cd0000 connected 2023-02-16 18:01:35,821 DEBUG [Listener at localhost/34831] zookeeper.ZKUtil(164): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 18:01:35,822 DEBUG [Listener at localhost/34831] zookeeper.ZKUtil(164): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:35,822 DEBUG [Listener at localhost/34831] zookeeper.ZKUtil(164): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 18:01:35,822 DEBUG [Listener at localhost/34831] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36327 2023-02-16 18:01:35,823 DEBUG [Listener at localhost/34831] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36327 2023-02-16 18:01:35,823 DEBUG [Listener at localhost/34831] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36327 2023-02-16 18:01:35,828 DEBUG [Listener at localhost/34831] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36327 2023-02-16 18:01:35,828 DEBUG [Listener at localhost/34831] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36327 2023-02-16 18:01:35,828 INFO [Listener at localhost/34831] master.HMaster(444): hbase.rootdir=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee, hbase.cluster.distributed=false 2023-02-16 18:01:35,841 INFO [Listener at localhost/34831] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 18:01:35,841 INFO [Listener at localhost/34831] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:35,841 INFO [Listener at localhost/34831] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:35,841 INFO [Listener at localhost/34831] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 18:01:35,842 INFO [Listener at localhost/34831] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:35,842 INFO [Listener at localhost/34831] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 18:01:35,842 INFO [Listener at localhost/34831] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 18:01:35,843 INFO [Listener at localhost/34831] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35421 2023-02-16 18:01:35,843 INFO [Listener at localhost/34831] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 18:01:35,845 DEBUG [Listener at localhost/34831] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:35,845 INFO [Listener at localhost/34831] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:35,846 INFO [Listener at localhost/34831] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:35,847 INFO [Listener at localhost/34831] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35421 connecting to ZooKeeper ensemble=127.0.0.1:54761 2023-02-16 18:01:35,850 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:354210x0, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 18:01:35,852 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:35421-0x1005e4b74cd0001 connected 2023-02-16 18:01:35,852 DEBUG [Listener at localhost/34831] zookeeper.ZKUtil(164): regionserver:35421-0x1005e4b74cd0001, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 18:01:35,853 DEBUG [Listener at localhost/34831] zookeeper.ZKUtil(164): regionserver:35421-0x1005e4b74cd0001, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:35,853 DEBUG [Listener at localhost/34831] zookeeper.ZKUtil(164): regionserver:35421-0x1005e4b74cd0001, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 18:01:35,855 DEBUG [Listener at localhost/34831] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35421 2023-02-16 18:01:35,856 DEBUG [Listener at localhost/34831] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35421 2023-02-16 18:01:35,856 DEBUG [Listener at localhost/34831] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35421 2023-02-16 18:01:35,861 DEBUG [Listener at localhost/34831] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35421 2023-02-16 18:01:35,861 DEBUG [Listener at localhost/34831] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35421 2023-02-16 18:01:35,877 INFO [Listener at localhost/34831] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 18:01:35,877 INFO [Listener at localhost/34831] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:35,877 INFO [Listener at localhost/34831] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:35,877 INFO [Listener at localhost/34831] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 18:01:35,877 INFO [Listener at localhost/34831] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:35,877 INFO [Listener at localhost/34831] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 18:01:35,877 INFO [Listener at localhost/34831] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 18:01:35,878 INFO [Listener at localhost/34831] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36643 2023-02-16 18:01:35,879 INFO [Listener at localhost/34831] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 18:01:35,881 DEBUG [Listener at localhost/34831] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:35,882 INFO [Listener at localhost/34831] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:35,883 INFO [Listener at localhost/34831] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:35,884 INFO [Listener at localhost/34831] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36643 connecting to ZooKeeper ensemble=127.0.0.1:54761 2023-02-16 18:01:35,896 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:366430x0, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 18:01:35,898 DEBUG [Listener at localhost/34831] zookeeper.ZKUtil(164): regionserver:366430x0, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 18:01:35,899 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36643-0x1005e4b74cd0002 connected 2023-02-16 18:01:35,899 DEBUG [Listener at localhost/34831] zookeeper.ZKUtil(164): regionserver:36643-0x1005e4b74cd0002, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:35,900 DEBUG [Listener at localhost/34831] zookeeper.ZKUtil(164): regionserver:36643-0x1005e4b74cd0002, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 18:01:35,900 DEBUG [Listener at localhost/34831] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36643 2023-02-16 18:01:35,901 DEBUG [Listener at localhost/34831] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36643 2023-02-16 18:01:35,901 DEBUG [Listener at localhost/34831] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36643 2023-02-16 18:01:35,902 DEBUG [Listener at localhost/34831] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36643 2023-02-16 18:01:35,902 DEBUG [Listener at localhost/34831] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36643 2023-02-16 18:01:35,905 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,36327,1676570495788 2023-02-16 18:01:35,906 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 18:01:35,907 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,36327,1676570495788 2023-02-16 18:01:35,908 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:35421-0x1005e4b74cd0001, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 18:01:35,908 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:36643-0x1005e4b74cd0002, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 18:01:35,908 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 18:01:35,909 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:35,910 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 18:01:35,911 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,36327,1676570495788 from backup master directory 2023-02-16 18:01:35,911 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 18:01:35,912 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,36327,1676570495788 2023-02-16 18:01:35,912 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 18:01:35,912 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 18:01:35,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,36327,1676570495788 2023-02-16 18:01:35,927 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/hbase.id with ID: 6f52b3d6-6375-474f-8111-fc1a6407f275 2023-02-16 18:01:35,938 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:35,941 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:35,966 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x20050d77 to 127.0.0.1:54761 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 18:01:35,974 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52426dae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 18:01:35,974 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 18:01:35,975 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-16 18:01:35,977 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 18:01:35,979 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/MasterData/data/master/store-tmp 2023-02-16 18:01:36,008 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:36,008 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 18:01:36,008 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:36,008 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:36,008 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 18:01:36,008 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:36,008 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:36,008 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 18:01:36,009 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/MasterData/WALs/jenkins-hbase4.apache.org,36327,1676570495788 2023-02-16 18:01:36,011 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36327%2C1676570495788, suffix=, logDir=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/MasterData/WALs/jenkins-hbase4.apache.org,36327,1676570495788, archiveDir=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/MasterData/oldWALs, maxLogs=10 2023-02-16 18:01:36,027 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34331,DS-e007f06d-9eba-4bd3-adfe-550d062a15cf,DISK] 2023-02-16 18:01:36,027 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44633,DS-a1f3bca0-cb2a-47ad-a37e-08ab5c015bcf,DISK] 2023-02-16 18:01:36,032 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/MasterData/WALs/jenkins-hbase4.apache.org,36327,1676570495788/jenkins-hbase4.apache.org%2C36327%2C1676570495788.1676570496012 2023-02-16 18:01:36,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44633,DS-a1f3bca0-cb2a-47ad-a37e-08ab5c015bcf,DISK], DatanodeInfoWithStorage[127.0.0.1:34331,DS-e007f06d-9eba-4bd3-adfe-550d062a15cf,DISK]] 2023-02-16 18:01:36,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-16 18:01:36,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:36,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:36,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:36,037 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:36,038 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-16 18:01:36,038 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-16 18:01:36,039 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:36,040 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:36,040 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:36,042 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:36,044 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:36,044 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61436435, jitterRate=-0.08452577888965607}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 18:01:36,044 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 18:01:36,044 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-16 18:01:36,045 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-16 18:01:36,046 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-16 18:01:36,046 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-16 18:01:36,046 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-16 18:01:36,046 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-16 18:01:36,046 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-16 18:01:36,048 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-16 18:01:36,049 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-16 18:01:36,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-16 18:01:36,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-16 18:01:36,060 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-16 18:01:36,060 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-16 18:01:36,060 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-16 18:01:36,063 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:36,063 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-16 18:01:36,064 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-16 18:01:36,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-16 18:01:36,066 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:35421-0x1005e4b74cd0001, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:36,066 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:36643-0x1005e4b74cd0002, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:36,066 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:36,066 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:36,066 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,36327,1676570495788, sessionid=0x1005e4b74cd0000, setting cluster-up flag (Was=false) 2023-02-16 18:01:36,070 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:36,075 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-16 18:01:36,075 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36327,1676570495788 2023-02-16 18:01:36,079 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:36,084 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-16 18:01:36,084 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36327,1676570495788 2023-02-16 18:01:36,085 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.hbase-snapshot/.tmp 2023-02-16 18:01:36,086 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-16 18:01:36,087 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 18:01:36,087 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 18:01:36,087 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 18:01:36,087 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 18:01:36,087 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-16 18:01:36,087 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:36,087 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 18:01:36,087 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:36,094 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676570526094 2023-02-16 18:01:36,096 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-16 18:01:36,096 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-16 18:01:36,096 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-16 18:01:36,097 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-16 18:01:36,097 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-16 18:01:36,097 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-16 18:01:36,097 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:36,097 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 18:01:36,097 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-16 18:01:36,097 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-16 18:01:36,098 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-16 18:01:36,098 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-16 18:01:36,098 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-16 18:01:36,098 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-16 18:01:36,099 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 18:01:36,099 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676570496099,5,FailOnTimeoutGroup] 2023-02-16 18:01:36,100 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676570496099,5,FailOnTimeoutGroup] 2023-02-16 18:01:36,100 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:36,100 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-16 18:01:36,100 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:36,100 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:36,105 INFO [RS:0;jenkins-hbase4:35421] regionserver.HRegionServer(952): ClusterId : 6f52b3d6-6375-474f-8111-fc1a6407f275 2023-02-16 18:01:36,105 DEBUG [RS:0;jenkins-hbase4:35421] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 18:01:36,108 INFO [RS:1;jenkins-hbase4:36643] regionserver.HRegionServer(952): ClusterId : 6f52b3d6-6375-474f-8111-fc1a6407f275 2023-02-16 18:01:36,108 DEBUG [RS:1;jenkins-hbase4:36643] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 18:01:36,109 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 18:01:36,110 DEBUG [RS:1;jenkins-hbase4:36643] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 18:01:36,110 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 18:01:36,110 DEBUG [RS:1;jenkins-hbase4:36643] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 18:01:36,110 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee 2023-02-16 18:01:36,111 DEBUG [RS:0;jenkins-hbase4:35421] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 18:01:36,112 DEBUG [RS:0;jenkins-hbase4:35421] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 18:01:36,113 DEBUG [RS:1;jenkins-hbase4:36643] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 18:01:36,114 DEBUG [RS:1;jenkins-hbase4:36643] zookeeper.ReadOnlyZKClient(139): Connect 0x2a2033b7 to 127.0.0.1:54761 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 18:01:36,114 DEBUG [RS:0;jenkins-hbase4:35421] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 18:01:36,116 DEBUG [RS:0;jenkins-hbase4:35421] zookeeper.ReadOnlyZKClient(139): Connect 0x1c312feb to 127.0.0.1:54761 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 18:01:36,121 DEBUG [RS:1;jenkins-hbase4:36643] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24e7d883, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 18:01:36,122 DEBUG [RS:1;jenkins-hbase4:36643] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20d858c7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 18:01:36,122 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:36,123 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 18:01:36,124 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/hbase/meta/1588230740/info 2023-02-16 18:01:36,125 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 18:01:36,125 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:36,125 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 18:01:36,126 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/hbase/meta/1588230740/rep_barrier 2023-02-16 18:01:36,127 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 18:01:36,127 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:36,127 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 18:01:36,128 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/hbase/meta/1588230740/table 2023-02-16 18:01:36,129 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 18:01:36,129 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:36,130 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/hbase/meta/1588230740 2023-02-16 18:01:36,130 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/hbase/meta/1588230740 2023-02-16 18:01:36,132 DEBUG [RS:0;jenkins-hbase4:35421] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12f6d21d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 18:01:36,132 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 18:01:36,132 DEBUG [RS:0;jenkins-hbase4:35421] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@16c9449b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 18:01:36,133 DEBUG [RS:1;jenkins-hbase4:36643] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:36643 2023-02-16 18:01:36,133 INFO [RS:1;jenkins-hbase4:36643] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 18:01:36,133 INFO [RS:1;jenkins-hbase4:36643] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 18:01:36,133 DEBUG [RS:1;jenkins-hbase4:36643] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 18:01:36,134 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 18:01:36,134 INFO [RS:1;jenkins-hbase4:36643] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,36327,1676570495788 with isa=jenkins-hbase4.apache.org/172.31.14.131:36643, startcode=1676570495876 2023-02-16 18:01:36,135 DEBUG [RS:1;jenkins-hbase4:36643] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 18:01:36,137 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52079, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 18:01:36,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:36,142 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:36,142 DEBUG [RS:1;jenkins-hbase4:36643] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee 2023-02-16 18:01:36,142 DEBUG [RS:1;jenkins-hbase4:36643] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:40013 2023-02-16 18:01:36,142 DEBUG [RS:1;jenkins-hbase4:36643] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 18:01:36,142 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70484296, jitterRate=0.05029785633087158}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 18:01:36,142 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 18:01:36,142 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 18:01:36,142 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 18:01:36,142 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 18:01:36,142 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 18:01:36,143 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 18:01:36,143 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 18:01:36,143 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 18:01:36,143 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:36,144 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 18:01:36,144 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-16 18:01:36,144 DEBUG [RS:0;jenkins-hbase4:35421] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:35421 2023-02-16 18:01:36,144 INFO [RS:0;jenkins-hbase4:35421] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 18:01:36,144 INFO [RS:0;jenkins-hbase4:35421] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 18:01:36,144 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-16 18:01:36,144 DEBUG [RS:1;jenkins-hbase4:36643] zookeeper.ZKUtil(162): regionserver:36643-0x1005e4b74cd0002, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:36,144 DEBUG [RS:0;jenkins-hbase4:35421] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 18:01:36,144 WARN [RS:1;jenkins-hbase4:36643] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 18:01:36,145 INFO [RS:1;jenkins-hbase4:36643] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 18:01:36,145 DEBUG [RS:1;jenkins-hbase4:36643] regionserver.HRegionServer(1947): logDir=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/WALs/jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:36,145 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36643,1676570495876] 2023-02-16 18:01:36,145 INFO [RS:0;jenkins-hbase4:35421] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,36327,1676570495788 with isa=jenkins-hbase4.apache.org/172.31.14.131:35421, startcode=1676570495840 2023-02-16 18:01:36,146 DEBUG [RS:0;jenkins-hbase4:35421] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 18:01:36,148 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-16 18:01:36,153 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-16 18:01:36,155 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55033, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 18:01:36,155 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:36,156 DEBUG [RS:0;jenkins-hbase4:35421] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee 2023-02-16 18:01:36,156 DEBUG [RS:0;jenkins-hbase4:35421] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:40013 2023-02-16 18:01:36,156 DEBUG [RS:0;jenkins-hbase4:35421] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 18:01:36,162 DEBUG [RS:1;jenkins-hbase4:36643] zookeeper.ZKUtil(162): regionserver:36643-0x1005e4b74cd0002, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:36,162 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:36643-0x1005e4b74cd0002, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:36,162 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:36,163 DEBUG [RS:0;jenkins-hbase4:35421] zookeeper.ZKUtil(162): regionserver:35421-0x1005e4b74cd0001, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:36,163 WARN [RS:0;jenkins-hbase4:35421] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 18:01:36,164 INFO [RS:0;jenkins-hbase4:35421] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 18:01:36,164 DEBUG [RS:0;jenkins-hbase4:35421] regionserver.HRegionServer(1947): logDir=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/WALs/jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:36,165 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:36643-0x1005e4b74cd0002, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:36,165 DEBUG [RS:1;jenkins-hbase4:36643] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 18:01:36,165 INFO [RS:1;jenkins-hbase4:36643] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 18:01:36,166 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:36643-0x1005e4b74cd0002, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:36,168 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35421,1676570495840] 2023-02-16 18:01:36,173 INFO [RS:1;jenkins-hbase4:36643] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 18:01:36,173 INFO [RS:1;jenkins-hbase4:36643] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 18:01:36,174 INFO [RS:1;jenkins-hbase4:36643] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:36,181 INFO [RS:1;jenkins-hbase4:36643] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 18:01:36,184 INFO [RS:1;jenkins-hbase4:36643] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:36,184 DEBUG [RS:1;jenkins-hbase4:36643] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:36,184 DEBUG [RS:1;jenkins-hbase4:36643] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:36,184 DEBUG [RS:1;jenkins-hbase4:36643] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:36,184 DEBUG [RS:1;jenkins-hbase4:36643] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:36,184 DEBUG [RS:1;jenkins-hbase4:36643] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:36,184 DEBUG [RS:1;jenkins-hbase4:36643] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 18:01:36,184 DEBUG [RS:1;jenkins-hbase4:36643] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:36,185 DEBUG [RS:1;jenkins-hbase4:36643] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:36,185 DEBUG [RS:1;jenkins-hbase4:36643] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:36,185 DEBUG [RS:1;jenkins-hbase4:36643] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:36,186 INFO [RS:1;jenkins-hbase4:36643] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:36,186 INFO [RS:1;jenkins-hbase4:36643] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:36,187 INFO [RS:1;jenkins-hbase4:36643] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:36,187 DEBUG [RS:0;jenkins-hbase4:35421] zookeeper.ZKUtil(162): regionserver:35421-0x1005e4b74cd0001, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:36,188 DEBUG [RS:0;jenkins-hbase4:35421] zookeeper.ZKUtil(162): regionserver:35421-0x1005e4b74cd0001, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:36,189 DEBUG [RS:0;jenkins-hbase4:35421] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 18:01:36,189 INFO [RS:0;jenkins-hbase4:35421] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 18:01:36,200 INFO [RS:0;jenkins-hbase4:35421] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 18:01:36,201 INFO [RS:1;jenkins-hbase4:36643] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 18:01:36,201 INFO [RS:1;jenkins-hbase4:36643] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36643,1676570495876-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:36,204 INFO [RS:0;jenkins-hbase4:35421] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 18:01:36,204 INFO [RS:0;jenkins-hbase4:35421] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:36,204 INFO [RS:0;jenkins-hbase4:35421] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 18:01:36,206 INFO [RS:0;jenkins-hbase4:35421] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:36,207 DEBUG [RS:0;jenkins-hbase4:35421] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:36,207 DEBUG [RS:0;jenkins-hbase4:35421] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:36,207 DEBUG [RS:0;jenkins-hbase4:35421] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:36,207 DEBUG [RS:0;jenkins-hbase4:35421] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:36,207 DEBUG [RS:0;jenkins-hbase4:35421] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:36,207 DEBUG [RS:0;jenkins-hbase4:35421] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 18:01:36,207 DEBUG [RS:0;jenkins-hbase4:35421] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:36,207 DEBUG [RS:0;jenkins-hbase4:35421] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:36,207 DEBUG [RS:0;jenkins-hbase4:35421] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:36,207 DEBUG [RS:0;jenkins-hbase4:35421] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:36,215 INFO [RS:0;jenkins-hbase4:35421] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:36,215 INFO [RS:0;jenkins-hbase4:35421] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:36,215 INFO [RS:0;jenkins-hbase4:35421] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:36,223 INFO [RS:1;jenkins-hbase4:36643] regionserver.Replication(203): jenkins-hbase4.apache.org,36643,1676570495876 started 2023-02-16 18:01:36,223 INFO [RS:1;jenkins-hbase4:36643] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,36643,1676570495876, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36643, sessionid=0x1005e4b74cd0002 2023-02-16 18:01:36,223 DEBUG [RS:1;jenkins-hbase4:36643] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 18:01:36,223 DEBUG [RS:1;jenkins-hbase4:36643] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:36,223 DEBUG [RS:1;jenkins-hbase4:36643] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36643,1676570495876' 2023-02-16 18:01:36,223 DEBUG [RS:1;jenkins-hbase4:36643] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:36,224 DEBUG [RS:1;jenkins-hbase4:36643] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:36,224 DEBUG [RS:1;jenkins-hbase4:36643] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 18:01:36,224 DEBUG [RS:1;jenkins-hbase4:36643] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 18:01:36,224 DEBUG [RS:1;jenkins-hbase4:36643] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:36,224 DEBUG [RS:1;jenkins-hbase4:36643] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36643,1676570495876' 2023-02-16 18:01:36,224 DEBUG [RS:1;jenkins-hbase4:36643] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:36,224 DEBUG [RS:1;jenkins-hbase4:36643] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:36,225 DEBUG [RS:1;jenkins-hbase4:36643] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 18:01:36,225 INFO [RS:1;jenkins-hbase4:36643] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 18:01:36,225 INFO [RS:1;jenkins-hbase4:36643] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 18:01:36,230 INFO [RS:0;jenkins-hbase4:35421] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 18:01:36,231 INFO [RS:0;jenkins-hbase4:35421] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35421,1676570495840-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:36,241 INFO [RS:0;jenkins-hbase4:35421] regionserver.Replication(203): jenkins-hbase4.apache.org,35421,1676570495840 started 2023-02-16 18:01:36,241 INFO [RS:0;jenkins-hbase4:35421] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,35421,1676570495840, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35421, sessionid=0x1005e4b74cd0001 2023-02-16 18:01:36,241 DEBUG [RS:0;jenkins-hbase4:35421] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 18:01:36,241 DEBUG [RS:0;jenkins-hbase4:35421] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:36,241 DEBUG [RS:0;jenkins-hbase4:35421] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35421,1676570495840' 2023-02-16 18:01:36,241 DEBUG [RS:0;jenkins-hbase4:35421] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:36,241 DEBUG [RS:0;jenkins-hbase4:35421] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:36,241 DEBUG [RS:0;jenkins-hbase4:35421] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 18:01:36,241 DEBUG [RS:0;jenkins-hbase4:35421] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 18:01:36,242 DEBUG [RS:0;jenkins-hbase4:35421] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:36,242 DEBUG [RS:0;jenkins-hbase4:35421] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35421,1676570495840' 2023-02-16 18:01:36,242 DEBUG [RS:0;jenkins-hbase4:35421] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:36,242 DEBUG [RS:0;jenkins-hbase4:35421] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:36,242 DEBUG [RS:0;jenkins-hbase4:35421] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 18:01:36,242 INFO [RS:0;jenkins-hbase4:35421] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 18:01:36,242 INFO [RS:0;jenkins-hbase4:35421] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 18:01:36,303 DEBUG [jenkins-hbase4:36327] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-16 18:01:36,303 DEBUG [jenkins-hbase4:36327] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 18:01:36,305 DEBUG [jenkins-hbase4:36327] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 18:01:36,305 DEBUG [jenkins-hbase4:36327] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 18:01:36,305 DEBUG [jenkins-hbase4:36327] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 18:01:36,307 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36643,1676570495876, state=OPENING 2023-02-16 18:01:36,309 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-16 18:01:36,310 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:36,311 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 18:01:36,311 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36643,1676570495876}] 2023-02-16 18:01:36,466 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:36,466 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 18:01:36,468 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55014, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 18:01:36,472 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-16 18:01:36,472 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 18:01:36,474 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36643%2C1676570495876.meta, suffix=.meta, logDir=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/WALs/jenkins-hbase4.apache.org,36643,1676570495876, archiveDir=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/oldWALs, maxLogs=32 2023-02-16 18:01:36,475 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-16 18:01:36,500 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34331,DS-e007f06d-9eba-4bd3-adfe-550d062a15cf,DISK] 2023-02-16 18:01:36,500 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44633,DS-a1f3bca0-cb2a-47ad-a37e-08ab5c015bcf,DISK] 2023-02-16 18:01:36,512 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/WALs/jenkins-hbase4.apache.org,36643,1676570495876/jenkins-hbase4.apache.org%2C36643%2C1676570495876.meta.1676570496474.meta 2023-02-16 18:01:36,513 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34331,DS-e007f06d-9eba-4bd3-adfe-550d062a15cf,DISK], DatanodeInfoWithStorage[127.0.0.1:44633,DS-a1f3bca0-cb2a-47ad-a37e-08ab5c015bcf,DISK]] 2023-02-16 18:01:36,515 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-16 18:01:36,515 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-16 18:01:36,516 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-16 18:01:36,516 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-16 18:01:36,516 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-16 18:01:36,516 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:36,516 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-16 18:01:36,516 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-16 18:01:36,518 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 18:01:36,520 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/hbase/meta/1588230740/info 2023-02-16 18:01:36,520 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/hbase/meta/1588230740/info 2023-02-16 18:01:36,520 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 18:01:36,521 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:36,521 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 18:01:36,522 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/hbase/meta/1588230740/rep_barrier 2023-02-16 18:01:36,522 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/hbase/meta/1588230740/rep_barrier 2023-02-16 18:01:36,522 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 18:01:36,523 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:36,523 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 18:01:36,524 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/hbase/meta/1588230740/table 2023-02-16 18:01:36,524 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/hbase/meta/1588230740/table 2023-02-16 18:01:36,524 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 18:01:36,525 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:36,527 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/hbase/meta/1588230740 2023-02-16 18:01:36,529 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/hbase/meta/1588230740 2023-02-16 18:01:36,533 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 18:01:36,546 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 18:01:36,550 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74610416, jitterRate=0.11178183555603027}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 18:01:36,550 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 18:01:36,551 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676570496466 2023-02-16 18:01:36,557 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-16 18:01:36,557 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-16 18:01:36,558 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36643,1676570495876, state=OPEN 2023-02-16 18:01:36,560 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-16 18:01:36,560 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 18:01:36,561 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-16 18:01:36,561 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36643,1676570495876 in 249 msec 2023-02-16 18:01:36,563 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-16 18:01:36,563 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 417 msec 2023-02-16 18:01:36,564 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 477 msec 2023-02-16 18:01:36,565 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676570496564, completionTime=-1 2023-02-16 18:01:36,565 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-16 18:01:36,565 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-16 18:01:36,568 DEBUG [hconnection-0x1c542859-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 18:01:36,570 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55016, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 18:01:36,572 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-16 18:01:36,572 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676570556572 2023-02-16 18:01:36,572 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676570616572 2023-02-16 18:01:36,572 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 7 msec 2023-02-16 18:01:36,582 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36327,1676570495788-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:36,582 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36327,1676570495788-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:36,582 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36327,1676570495788-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:36,582 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:36327, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:36,582 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:36,583 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-16 18:01:36,583 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 18:01:36,583 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-16 18:01:36,585 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 18:01:36,586 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-16 18:01:36,586 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 18:01:36,587 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/hbase/namespace/e10a41981e221e4dbacc2fa2ec061c41 2023-02-16 18:01:36,588 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/hbase/namespace/e10a41981e221e4dbacc2fa2ec061c41 empty. 2023-02-16 18:01:36,589 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/hbase/namespace/e10a41981e221e4dbacc2fa2ec061c41 2023-02-16 18:01:36,589 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-16 18:01:36,606 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-16 18:01:36,607 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => e10a41981e221e4dbacc2fa2ec061c41, NAME => 'hbase:namespace,,1676570496583.e10a41981e221e4dbacc2fa2ec061c41.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp 2023-02-16 18:01:36,622 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676570496583.e10a41981e221e4dbacc2fa2ec061c41.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:36,622 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing e10a41981e221e4dbacc2fa2ec061c41, disabling compactions & flushes 2023-02-16 18:01:36,622 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676570496583.e10a41981e221e4dbacc2fa2ec061c41. 2023-02-16 18:01:36,622 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676570496583.e10a41981e221e4dbacc2fa2ec061c41. 2023-02-16 18:01:36,622 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676570496583.e10a41981e221e4dbacc2fa2ec061c41. after waiting 0 ms 2023-02-16 18:01:36,622 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676570496583.e10a41981e221e4dbacc2fa2ec061c41. 2023-02-16 18:01:36,622 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676570496583.e10a41981e221e4dbacc2fa2ec061c41. 2023-02-16 18:01:36,622 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for e10a41981e221e4dbacc2fa2ec061c41: 2023-02-16 18:01:36,625 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 18:01:36,626 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676570496583.e10a41981e221e4dbacc2fa2ec061c41.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676570496626"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570496626"}]},"ts":"1676570496626"} 2023-02-16 18:01:36,628 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 18:01:36,629 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 18:01:36,629 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676570496629"}]},"ts":"1676570496629"} 2023-02-16 18:01:36,631 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-16 18:01:36,635 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 18:01:36,636 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 18:01:36,636 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 18:01:36,636 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 18:01:36,640 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e10a41981e221e4dbacc2fa2ec061c41, ASSIGN}] 2023-02-16 18:01:36,645 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e10a41981e221e4dbacc2fa2ec061c41, ASSIGN 2023-02-16 18:01:36,646 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=e10a41981e221e4dbacc2fa2ec061c41, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35421,1676570495840; forceNewPlan=false, retain=false 2023-02-16 18:01:36,797 INFO [jenkins-hbase4:36327] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 18:01:36,797 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e10a41981e221e4dbacc2fa2ec061c41, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:36,798 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676570496583.e10a41981e221e4dbacc2fa2ec061c41.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676570496797"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570496797"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570496797"}]},"ts":"1676570496797"} 2023-02-16 18:01:36,800 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure e10a41981e221e4dbacc2fa2ec061c41, server=jenkins-hbase4.apache.org,35421,1676570495840}] 2023-02-16 18:01:36,953 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:36,953 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 18:01:36,954 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32868, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 18:01:36,958 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676570496583.e10a41981e221e4dbacc2fa2ec061c41. 2023-02-16 18:01:36,959 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35421%2C1676570495840, suffix=, logDir=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/WALs/jenkins-hbase4.apache.org,35421,1676570495840, archiveDir=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/oldWALs, maxLogs=32 2023-02-16 18:01:36,975 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44633,DS-a1f3bca0-cb2a-47ad-a37e-08ab5c015bcf,DISK] 2023-02-16 18:01:36,975 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34331,DS-e007f06d-9eba-4bd3-adfe-550d062a15cf,DISK] 2023-02-16 18:01:36,979 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/WALs/jenkins-hbase4.apache.org,35421,1676570495840/jenkins-hbase4.apache.org%2C35421%2C1676570495840.1676570496960 2023-02-16 18:01:36,979 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34331,DS-e007f06d-9eba-4bd3-adfe-550d062a15cf,DISK], DatanodeInfoWithStorage[127.0.0.1:44633,DS-a1f3bca0-cb2a-47ad-a37e-08ab5c015bcf,DISK]] 2023-02-16 18:01:36,979 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e10a41981e221e4dbacc2fa2ec061c41, NAME => 'hbase:namespace,,1676570496583.e10a41981e221e4dbacc2fa2ec061c41.', STARTKEY => '', ENDKEY => ''} 2023-02-16 18:01:36,979 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace e10a41981e221e4dbacc2fa2ec061c41 2023-02-16 18:01:36,980 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676570496583.e10a41981e221e4dbacc2fa2ec061c41.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:36,980 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e10a41981e221e4dbacc2fa2ec061c41 2023-02-16 18:01:36,980 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e10a41981e221e4dbacc2fa2ec061c41 2023-02-16 18:01:36,981 INFO [StoreOpener-e10a41981e221e4dbacc2fa2ec061c41-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e10a41981e221e4dbacc2fa2ec061c41 2023-02-16 18:01:36,982 DEBUG [StoreOpener-e10a41981e221e4dbacc2fa2ec061c41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/hbase/namespace/e10a41981e221e4dbacc2fa2ec061c41/info 2023-02-16 18:01:36,982 DEBUG [StoreOpener-e10a41981e221e4dbacc2fa2ec061c41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/hbase/namespace/e10a41981e221e4dbacc2fa2ec061c41/info 2023-02-16 18:01:36,982 INFO [StoreOpener-e10a41981e221e4dbacc2fa2ec061c41-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e10a41981e221e4dbacc2fa2ec061c41 columnFamilyName info 2023-02-16 18:01:36,983 INFO [StoreOpener-e10a41981e221e4dbacc2fa2ec061c41-1] regionserver.HStore(310): Store=e10a41981e221e4dbacc2fa2ec061c41/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:36,984 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/hbase/namespace/e10a41981e221e4dbacc2fa2ec061c41 2023-02-16 18:01:36,984 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/hbase/namespace/e10a41981e221e4dbacc2fa2ec061c41 2023-02-16 18:01:36,986 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e10a41981e221e4dbacc2fa2ec061c41 2023-02-16 18:01:36,988 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/hbase/namespace/e10a41981e221e4dbacc2fa2ec061c41/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:36,988 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e10a41981e221e4dbacc2fa2ec061c41; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61831410, jitterRate=-0.07864019274711609}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 18:01:36,988 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e10a41981e221e4dbacc2fa2ec061c41: 2023-02-16 18:01:36,989 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676570496583.e10a41981e221e4dbacc2fa2ec061c41., pid=6, masterSystemTime=1676570496952 2023-02-16 18:01:36,992 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676570496583.e10a41981e221e4dbacc2fa2ec061c41. 2023-02-16 18:01:36,993 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676570496583.e10a41981e221e4dbacc2fa2ec061c41. 2023-02-16 18:01:36,993 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e10a41981e221e4dbacc2fa2ec061c41, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:36,993 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676570496583.e10a41981e221e4dbacc2fa2ec061c41.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676570496993"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676570496993"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676570496993"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676570496993"}]},"ts":"1676570496993"} 2023-02-16 18:01:36,996 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-16 18:01:36,996 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure e10a41981e221e4dbacc2fa2ec061c41, server=jenkins-hbase4.apache.org,35421,1676570495840 in 194 msec 2023-02-16 18:01:36,997 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-16 18:01:36,997 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=e10a41981e221e4dbacc2fa2ec061c41, ASSIGN in 360 msec 2023-02-16 18:01:36,997 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 18:01:36,998 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676570496997"}]},"ts":"1676570496997"} 2023-02-16 18:01:36,999 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-16 18:01:37,000 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 18:01:37,001 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 418 msec 2023-02-16 18:01:37,085 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-16 18:01:37,090 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-16 18:01:37,091 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:37,093 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 18:01:37,094 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32876, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 18:01:37,096 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-16 18:01:37,105 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 18:01:37,107 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-16 18:01:37,118 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-16 18:01:37,125 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 18:01:37,128 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-16 18:01:37,132 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-16 18:01:37,139 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-16 18:01:37,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.227sec 2023-02-16 18:01:37,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-16 18:01:37,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-16 18:01:37,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-16 18:01:37,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36327,1676570495788-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-16 18:01:37,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36327,1676570495788-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-16 18:01:37,141 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-16 18:01:37,207 DEBUG [Listener at localhost/34831] zookeeper.ReadOnlyZKClient(139): Connect 0x6b19c6a6 to 127.0.0.1:54761 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 18:01:37,212 DEBUG [Listener at localhost/34831] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12bb827b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 18:01:37,214 DEBUG [hconnection-0x7c8a5209-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 18:01:37,216 INFO [RS-EventLoopGroup-14-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55022, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 18:01:37,218 INFO [Listener at localhost/34831] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,36327,1676570495788 2023-02-16 18:01:37,218 DEBUG [Listener at localhost/34831] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-16 18:01:37,221 DEBUG [Listener at localhost/34831] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-16 18:01:37,222 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59606, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-16 18:01:37,223 INFO [Listener at localhost/34831] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-16 18:01:37,223 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-16 18:01:37,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-16 18:01:37,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 172.31.14.131:59606 deadline: 1676570557223, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-16 18:01:37,224 INFO [Listener at localhost/34831] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-16 18:01:37,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 18:01:37,227 INFO [RS:1;jenkins-hbase4:36643] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36643%2C1676570495876, suffix=, logDir=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/WALs/jenkins-hbase4.apache.org,36643,1676570495876, archiveDir=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/oldWALs, maxLogs=32 2023-02-16 18:01:37,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:37,229 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 18:01:37,229 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-16 18:01:37,229 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 18:01:37,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 18:01:37,238 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/3b23ebcb7a063fa26cbc8e7ad4af5a30 2023-02-16 18:01:37,238 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f 2023-02-16 18:01:37,238 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804 2023-02-16 18:01:37,238 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac 2023-02-16 18:01:37,238 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498 2023-02-16 18:01:37,238 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f 2023-02-16 18:01:37,238 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2 2023-02-16 18:01:37,238 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5 2023-02-16 18:01:37,238 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/3b23ebcb7a063fa26cbc8e7ad4af5a30 empty. 2023-02-16 18:01:37,238 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804 empty. 2023-02-16 18:01:37,239 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f empty. 2023-02-16 18:01:37,239 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac empty. 2023-02-16 18:01:37,239 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498 empty. 2023-02-16 18:01:37,239 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2 empty. 2023-02-16 18:01:37,239 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5 empty. 2023-02-16 18:01:37,239 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/3b23ebcb7a063fa26cbc8e7ad4af5a30 2023-02-16 18:01:37,239 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804 2023-02-16 18:01:37,239 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9 2023-02-16 18:01:37,239 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/86f2541ba97be80de5233420d382624d 2023-02-16 18:01:37,239 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f empty. 2023-02-16 18:01:37,239 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac 2023-02-16 18:01:37,239 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/86f2541ba97be80de5233420d382624d empty. 2023-02-16 18:01:37,239 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f 2023-02-16 18:01:37,239 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498 2023-02-16 18:01:37,240 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f 2023-02-16 18:01:37,240 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9 empty. 2023-02-16 18:01:37,240 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5 2023-02-16 18:01:37,240 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2 2023-02-16 18:01:37,240 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/86f2541ba97be80de5233420d382624d 2023-02-16 18:01:37,240 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9 2023-02-16 18:01:37,240 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-16 18:01:37,243 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44633,DS-a1f3bca0-cb2a-47ad-a37e-08ab5c015bcf,DISK] 2023-02-16 18:01:37,243 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34331,DS-e007f06d-9eba-4bd3-adfe-550d062a15cf,DISK] 2023-02-16 18:01:37,247 INFO [RS:1;jenkins-hbase4:36643] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/WALs/jenkins-hbase4.apache.org,36643,1676570495876/jenkins-hbase4.apache.org%2C36643%2C1676570495876.1676570497228 2023-02-16 18:01:37,247 DEBUG [RS:1;jenkins-hbase4:36643] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44633,DS-a1f3bca0-cb2a-47ad-a37e-08ab5c015bcf,DISK], DatanodeInfoWithStorage[127.0.0.1:34331,DS-e007f06d-9eba-4bd3-adfe-550d062a15cf,DISK]] 2023-02-16 18:01:37,251 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-16 18:01:37,252 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => e7445758c3b995e9c904d54090c0098f, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676570497226.e7445758c3b995e9c904d54090c0098f.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp 2023-02-16 18:01:37,253 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3b23ebcb7a063fa26cbc8e7ad4af5a30, NAME => 'testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp 2023-02-16 18:01:37,253 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 95c95ff4a3c7bc5bf657c871bd52be7f, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp 2023-02-16 18:01:37,260 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676570497226.e7445758c3b995e9c904d54090c0098f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:37,260 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing e7445758c3b995e9c904d54090c0098f, disabling compactions & flushes 2023-02-16 18:01:37,260 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676570497226.e7445758c3b995e9c904d54090c0098f. 2023-02-16 18:01:37,260 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676570497226.e7445758c3b995e9c904d54090c0098f. 2023-02-16 18:01:37,260 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676570497226.e7445758c3b995e9c904d54090c0098f. after waiting 0 ms 2023-02-16 18:01:37,260 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676570497226.e7445758c3b995e9c904d54090c0098f. 2023-02-16 18:01:37,260 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676570497226.e7445758c3b995e9c904d54090c0098f. 2023-02-16 18:01:37,260 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for e7445758c3b995e9c904d54090c0098f: 2023-02-16 18:01:37,260 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => aeef298fd4c8182aec11e6f13fb1f498, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp 2023-02-16 18:01:37,261 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:37,261 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 95c95ff4a3c7bc5bf657c871bd52be7f, disabling compactions & flushes 2023-02-16 18:01:37,261 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:37,261 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f. 2023-02-16 18:01:37,261 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 3b23ebcb7a063fa26cbc8e7ad4af5a30, disabling compactions & flushes 2023-02-16 18:01:37,261 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30. 2023-02-16 18:01:37,261 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30. 2023-02-16 18:01:37,261 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f. 2023-02-16 18:01:37,261 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30. after waiting 0 ms 2023-02-16 18:01:37,261 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30. 2023-02-16 18:01:37,261 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f. after waiting 0 ms 2023-02-16 18:01:37,261 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30. 2023-02-16 18:01:37,261 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 3b23ebcb7a063fa26cbc8e7ad4af5a30: 2023-02-16 18:01:37,261 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f. 2023-02-16 18:01:37,261 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f. 2023-02-16 18:01:37,261 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 95c95ff4a3c7bc5bf657c871bd52be7f: 2023-02-16 18:01:37,262 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 664fd63b9893f58d619f365d46c359ac, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp 2023-02-16 18:01:37,262 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 44bd149ba1e4dc457155e72145b92804, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676570497226.44bd149ba1e4dc457155e72145b92804.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp 2023-02-16 18:01:37,268 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:37,268 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing aeef298fd4c8182aec11e6f13fb1f498, disabling compactions & flushes 2023-02-16 18:01:37,268 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498. 2023-02-16 18:01:37,268 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498. 2023-02-16 18:01:37,268 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498. after waiting 0 ms 2023-02-16 18:01:37,268 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498. 2023-02-16 18:01:37,268 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498. 2023-02-16 18:01:37,268 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for aeef298fd4c8182aec11e6f13fb1f498: 2023-02-16 18:01:37,269 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => a5cf4b56498ec7331bb3a0f533d41fc2, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp 2023-02-16 18:01:37,269 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:37,269 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 664fd63b9893f58d619f365d46c359ac, disabling compactions & flushes 2023-02-16 18:01:37,269 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac. 2023-02-16 18:01:37,269 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac. 2023-02-16 18:01:37,269 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac. after waiting 0 ms 2023-02-16 18:01:37,269 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac. 2023-02-16 18:01:37,269 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac. 2023-02-16 18:01:37,269 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 664fd63b9893f58d619f365d46c359ac: 2023-02-16 18:01:37,270 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 92a7db0f18e3fd67d4c8e3c9b1bf61e5, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp 2023-02-16 18:01:37,275 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:37,275 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing a5cf4b56498ec7331bb3a0f533d41fc2, disabling compactions & flushes 2023-02-16 18:01:37,275 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2. 2023-02-16 18:01:37,275 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2. 2023-02-16 18:01:37,275 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2. after waiting 0 ms 2023-02-16 18:01:37,275 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2. 2023-02-16 18:01:37,275 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2. 2023-02-16 18:01:37,275 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for a5cf4b56498ec7331bb3a0f533d41fc2: 2023-02-16 18:01:37,276 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 777832e7eb6d1f4669aed8cac8c2cce9, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp 2023-02-16 18:01:37,276 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:37,276 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 92a7db0f18e3fd67d4c8e3c9b1bf61e5, disabling compactions & flushes 2023-02-16 18:01:37,276 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5. 2023-02-16 18:01:37,276 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5. 2023-02-16 18:01:37,276 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5. after waiting 0 ms 2023-02-16 18:01:37,277 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5. 2023-02-16 18:01:37,277 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5. 2023-02-16 18:01:37,277 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 92a7db0f18e3fd67d4c8e3c9b1bf61e5: 2023-02-16 18:01:37,277 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 86f2541ba97be80de5233420d382624d, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp 2023-02-16 18:01:37,282 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:37,282 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 777832e7eb6d1f4669aed8cac8c2cce9, disabling compactions & flushes 2023-02-16 18:01:37,282 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9. 2023-02-16 18:01:37,282 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9. 2023-02-16 18:01:37,282 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9. after waiting 0 ms 2023-02-16 18:01:37,282 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9. 2023-02-16 18:01:37,282 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9. 2023-02-16 18:01:37,282 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 777832e7eb6d1f4669aed8cac8c2cce9: 2023-02-16 18:01:37,282 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:37,283 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 86f2541ba97be80de5233420d382624d, disabling compactions & flushes 2023-02-16 18:01:37,283 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d. 2023-02-16 18:01:37,283 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d. 2023-02-16 18:01:37,283 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d. after waiting 0 ms 2023-02-16 18:01:37,283 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d. 2023-02-16 18:01:37,283 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d. 2023-02-16 18:01:37,283 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 86f2541ba97be80de5233420d382624d: 2023-02-16 18:01:37,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 18:01:37,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 18:01:37,670 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676570497226.44bd149ba1e4dc457155e72145b92804.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:37,670 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 44bd149ba1e4dc457155e72145b92804, disabling compactions & flushes 2023-02-16 18:01:37,670 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676570497226.44bd149ba1e4dc457155e72145b92804. 2023-02-16 18:01:37,670 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676570497226.44bd149ba1e4dc457155e72145b92804. 2023-02-16 18:01:37,670 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676570497226.44bd149ba1e4dc457155e72145b92804. after waiting 0 ms 2023-02-16 18:01:37,670 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676570497226.44bd149ba1e4dc457155e72145b92804. 2023-02-16 18:01:37,670 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676570497226.44bd149ba1e4dc457155e72145b92804. 2023-02-16 18:01:37,670 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 44bd149ba1e4dc457155e72145b92804: 2023-02-16 18:01:37,673 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 18:01:37,674 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676570497226.e7445758c3b995e9c904d54090c0098f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676570497674"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570497674"}]},"ts":"1676570497674"} 2023-02-16 18:01:37,675 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676570497674"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570497674"}]},"ts":"1676570497674"} 2023-02-16 18:01:37,675 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676570497674"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570497674"}]},"ts":"1676570497674"} 2023-02-16 18:01:37,675 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676570497674"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570497674"}]},"ts":"1676570497674"} 2023-02-16 18:01:37,675 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676570497674"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570497674"}]},"ts":"1676570497674"} 2023-02-16 18:01:37,675 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676570497674"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570497674"}]},"ts":"1676570497674"} 2023-02-16 18:01:37,675 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676570497674"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570497674"}]},"ts":"1676570497674"} 2023-02-16 18:01:37,675 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676570497674"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570497674"}]},"ts":"1676570497674"} 2023-02-16 18:01:37,675 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676570497674"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570497674"}]},"ts":"1676570497674"} 2023-02-16 18:01:37,675 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676570497226.44bd149ba1e4dc457155e72145b92804.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676570497674"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570497674"}]},"ts":"1676570497674"} 2023-02-16 18:01:37,677 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-16 18:01:37,678 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 18:01:37,678 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676570497678"}]},"ts":"1676570497678"} 2023-02-16 18:01:37,679 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-16 18:01:37,682 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 18:01:37,688 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 18:01:37,688 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 18:01:37,688 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 18:01:37,688 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3b23ebcb7a063fa26cbc8e7ad4af5a30, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=95c95ff4a3c7bc5bf657c871bd52be7f, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e7445758c3b995e9c904d54090c0098f, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=aeef298fd4c8182aec11e6f13fb1f498, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=664fd63b9893f58d619f365d46c359ac, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=44bd149ba1e4dc457155e72145b92804, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a5cf4b56498ec7331bb3a0f533d41fc2, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=92a7db0f18e3fd67d4c8e3c9b1bf61e5, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=777832e7eb6d1f4669aed8cac8c2cce9, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=86f2541ba97be80de5233420d382624d, ASSIGN}] 2023-02-16 18:01:37,691 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=95c95ff4a3c7bc5bf657c871bd52be7f, ASSIGN 2023-02-16 18:01:37,691 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3b23ebcb7a063fa26cbc8e7ad4af5a30, ASSIGN 2023-02-16 18:01:37,692 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e7445758c3b995e9c904d54090c0098f, ASSIGN 2023-02-16 18:01:37,692 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=aeef298fd4c8182aec11e6f13fb1f498, ASSIGN 2023-02-16 18:01:37,695 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=95c95ff4a3c7bc5bf657c871bd52be7f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35421,1676570495840; forceNewPlan=false, retain=false 2023-02-16 18:01:37,695 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=aeef298fd4c8182aec11e6f13fb1f498, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36643,1676570495876; forceNewPlan=false, retain=false 2023-02-16 18:01:37,695 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=86f2541ba97be80de5233420d382624d, ASSIGN 2023-02-16 18:01:37,695 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e7445758c3b995e9c904d54090c0098f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35421,1676570495840; forceNewPlan=false, retain=false 2023-02-16 18:01:37,695 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3b23ebcb7a063fa26cbc8e7ad4af5a30, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36643,1676570495876; forceNewPlan=false, retain=false 2023-02-16 18:01:37,696 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=777832e7eb6d1f4669aed8cac8c2cce9, ASSIGN 2023-02-16 18:01:37,696 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=92a7db0f18e3fd67d4c8e3c9b1bf61e5, ASSIGN 2023-02-16 18:01:37,697 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a5cf4b56498ec7331bb3a0f533d41fc2, ASSIGN 2023-02-16 18:01:37,697 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=44bd149ba1e4dc457155e72145b92804, ASSIGN 2023-02-16 18:01:37,697 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=777832e7eb6d1f4669aed8cac8c2cce9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36643,1676570495876; forceNewPlan=false, retain=false 2023-02-16 18:01:37,698 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=92a7db0f18e3fd67d4c8e3c9b1bf61e5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35421,1676570495840; forceNewPlan=false, retain=false 2023-02-16 18:01:37,698 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a5cf4b56498ec7331bb3a0f533d41fc2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36643,1676570495876; forceNewPlan=false, retain=false 2023-02-16 18:01:37,699 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=44bd149ba1e4dc457155e72145b92804, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36643,1676570495876; forceNewPlan=false, retain=false 2023-02-16 18:01:37,699 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=664fd63b9893f58d619f365d46c359ac, ASSIGN 2023-02-16 18:01:37,700 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=664fd63b9893f58d619f365d46c359ac, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35421,1676570495840; forceNewPlan=false, retain=false 2023-02-16 18:01:37,702 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=86f2541ba97be80de5233420d382624d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35421,1676570495840; forceNewPlan=false, retain=false 2023-02-16 18:01:37,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 18:01:37,845 INFO [jenkins-hbase4:36327] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-16 18:01:37,851 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=44bd149ba1e4dc457155e72145b92804, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:37,851 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=3b23ebcb7a063fa26cbc8e7ad4af5a30, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:37,851 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=aeef298fd4c8182aec11e6f13fb1f498, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:37,851 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=777832e7eb6d1f4669aed8cac8c2cce9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:37,851 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676570497851"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570497851"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570497851"}]},"ts":"1676570497851"} 2023-02-16 18:01:37,851 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=a5cf4b56498ec7331bb3a0f533d41fc2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:37,852 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676570497851"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570497851"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570497851"}]},"ts":"1676570497851"} 2023-02-16 18:01:37,852 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676570497851"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570497851"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570497851"}]},"ts":"1676570497851"} 2023-02-16 18:01:37,851 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676570497851"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570497851"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570497851"}]},"ts":"1676570497851"} 2023-02-16 18:01:37,851 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676570497226.44bd149ba1e4dc457155e72145b92804.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676570497851"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570497851"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570497851"}]},"ts":"1676570497851"} 2023-02-16 18:01:37,855 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=19, state=RUNNABLE; OpenRegionProcedure 777832e7eb6d1f4669aed8cac8c2cce9, server=jenkins-hbase4.apache.org,36643,1676570495876}] 2023-02-16 18:01:37,855 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=14, state=RUNNABLE; OpenRegionProcedure aeef298fd4c8182aec11e6f13fb1f498, server=jenkins-hbase4.apache.org,36643,1676570495876}] 2023-02-16 18:01:37,856 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=11, state=RUNNABLE; OpenRegionProcedure 3b23ebcb7a063fa26cbc8e7ad4af5a30, server=jenkins-hbase4.apache.org,36643,1676570495876}] 2023-02-16 18:01:37,857 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=17, state=RUNNABLE; OpenRegionProcedure a5cf4b56498ec7331bb3a0f533d41fc2, server=jenkins-hbase4.apache.org,36643,1676570495876}] 2023-02-16 18:01:37,857 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=16, state=RUNNABLE; OpenRegionProcedure 44bd149ba1e4dc457155e72145b92804, server=jenkins-hbase4.apache.org,36643,1676570495876}] 2023-02-16 18:01:37,859 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=664fd63b9893f58d619f365d46c359ac, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:37,859 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676570497859"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570497859"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570497859"}]},"ts":"1676570497859"} 2023-02-16 18:01:37,860 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=86f2541ba97be80de5233420d382624d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:37,860 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676570497860"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570497860"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570497860"}]},"ts":"1676570497860"} 2023-02-16 18:01:37,860 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=e7445758c3b995e9c904d54090c0098f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:37,860 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676570497226.e7445758c3b995e9c904d54090c0098f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676570497860"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570497860"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570497860"}]},"ts":"1676570497860"} 2023-02-16 18:01:37,861 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=15, state=RUNNABLE; OpenRegionProcedure 664fd63b9893f58d619f365d46c359ac, server=jenkins-hbase4.apache.org,35421,1676570495840}] 2023-02-16 18:01:37,862 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=95c95ff4a3c7bc5bf657c871bd52be7f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:37,862 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676570497862"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570497862"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570497862"}]},"ts":"1676570497862"} 2023-02-16 18:01:37,863 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=20, state=RUNNABLE; OpenRegionProcedure 86f2541ba97be80de5233420d382624d, server=jenkins-hbase4.apache.org,35421,1676570495840}] 2023-02-16 18:01:37,863 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=92a7db0f18e3fd67d4c8e3c9b1bf61e5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:37,863 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676570497863"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570497863"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570497863"}]},"ts":"1676570497863"} 2023-02-16 18:01:37,864 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=13, state=RUNNABLE; OpenRegionProcedure e7445758c3b995e9c904d54090c0098f, server=jenkins-hbase4.apache.org,35421,1676570495840}] 2023-02-16 18:01:37,865 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=12, state=RUNNABLE; OpenRegionProcedure 95c95ff4a3c7bc5bf657c871bd52be7f, server=jenkins-hbase4.apache.org,35421,1676570495840}] 2023-02-16 18:01:37,865 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=18, state=RUNNABLE; OpenRegionProcedure 92a7db0f18e3fd67d4c8e3c9b1bf61e5, server=jenkins-hbase4.apache.org,35421,1676570495840}] 2023-02-16 18:01:38,010 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2. 2023-02-16 18:01:38,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a5cf4b56498ec7331bb3a0f533d41fc2, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-16 18:01:38,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion a5cf4b56498ec7331bb3a0f533d41fc2 2023-02-16 18:01:38,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:38,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a5cf4b56498ec7331bb3a0f533d41fc2 2023-02-16 18:01:38,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a5cf4b56498ec7331bb3a0f533d41fc2 2023-02-16 18:01:38,012 INFO [StoreOpener-a5cf4b56498ec7331bb3a0f533d41fc2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a5cf4b56498ec7331bb3a0f533d41fc2 2023-02-16 18:01:38,013 DEBUG [StoreOpener-a5cf4b56498ec7331bb3a0f533d41fc2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/f1 2023-02-16 18:01:38,013 DEBUG [StoreOpener-a5cf4b56498ec7331bb3a0f533d41fc2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/f1 2023-02-16 18:01:38,014 INFO [StoreOpener-a5cf4b56498ec7331bb3a0f533d41fc2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a5cf4b56498ec7331bb3a0f533d41fc2 columnFamilyName f1 2023-02-16 18:01:38,014 INFO [StoreOpener-a5cf4b56498ec7331bb3a0f533d41fc2-1] regionserver.HStore(310): Store=a5cf4b56498ec7331bb3a0f533d41fc2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:38,014 INFO [StoreOpener-a5cf4b56498ec7331bb3a0f533d41fc2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a5cf4b56498ec7331bb3a0f533d41fc2 2023-02-16 18:01:38,015 DEBUG [StoreOpener-a5cf4b56498ec7331bb3a0f533d41fc2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/f2 2023-02-16 18:01:38,015 DEBUG [StoreOpener-a5cf4b56498ec7331bb3a0f533d41fc2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/f2 2023-02-16 18:01:38,015 INFO [StoreOpener-a5cf4b56498ec7331bb3a0f533d41fc2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a5cf4b56498ec7331bb3a0f533d41fc2 columnFamilyName f2 2023-02-16 18:01:38,016 INFO [StoreOpener-a5cf4b56498ec7331bb3a0f533d41fc2-1] regionserver.HStore(310): Store=a5cf4b56498ec7331bb3a0f533d41fc2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:38,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2 2023-02-16 18:01:38,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2 2023-02-16 18:01:38,018 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d. 2023-02-16 18:01:38,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 86f2541ba97be80de5233420d382624d, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-16 18:01:38,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 86f2541ba97be80de5233420d382624d 2023-02-16 18:01:38,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:38,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 86f2541ba97be80de5233420d382624d 2023-02-16 18:01:38,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 86f2541ba97be80de5233420d382624d 2023-02-16 18:01:38,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:38,019 INFO [StoreOpener-86f2541ba97be80de5233420d382624d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 86f2541ba97be80de5233420d382624d 2023-02-16 18:01:38,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a5cf4b56498ec7331bb3a0f533d41fc2 2023-02-16 18:01:38,021 DEBUG [StoreOpener-86f2541ba97be80de5233420d382624d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/86f2541ba97be80de5233420d382624d/f1 2023-02-16 18:01:38,021 DEBUG [StoreOpener-86f2541ba97be80de5233420d382624d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/86f2541ba97be80de5233420d382624d/f1 2023-02-16 18:01:38,021 INFO [StoreOpener-86f2541ba97be80de5233420d382624d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 86f2541ba97be80de5233420d382624d columnFamilyName f1 2023-02-16 18:01:38,021 INFO [StoreOpener-86f2541ba97be80de5233420d382624d-1] regionserver.HStore(310): Store=86f2541ba97be80de5233420d382624d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:38,021 INFO [StoreOpener-86f2541ba97be80de5233420d382624d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 86f2541ba97be80de5233420d382624d 2023-02-16 18:01:38,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:38,022 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a5cf4b56498ec7331bb3a0f533d41fc2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69448648, jitterRate=0.034865498542785645}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:38,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a5cf4b56498ec7331bb3a0f533d41fc2: 2023-02-16 18:01:38,023 DEBUG [StoreOpener-86f2541ba97be80de5233420d382624d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/86f2541ba97be80de5233420d382624d/f2 2023-02-16 18:01:38,023 DEBUG [StoreOpener-86f2541ba97be80de5233420d382624d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/86f2541ba97be80de5233420d382624d/f2 2023-02-16 18:01:38,023 INFO [StoreOpener-86f2541ba97be80de5233420d382624d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 86f2541ba97be80de5233420d382624d columnFamilyName f2 2023-02-16 18:01:38,023 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2., pid=24, masterSystemTime=1676570498007 2023-02-16 18:01:38,024 INFO [StoreOpener-86f2541ba97be80de5233420d382624d-1] regionserver.HStore(310): Store=86f2541ba97be80de5233420d382624d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:38,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/86f2541ba97be80de5233420d382624d 2023-02-16 18:01:38,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/86f2541ba97be80de5233420d382624d 2023-02-16 18:01:38,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2. 2023-02-16 18:01:38,025 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2. 2023-02-16 18:01:38,025 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30. 2023-02-16 18:01:38,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3b23ebcb7a063fa26cbc8e7ad4af5a30, NAME => 'testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-16 18:01:38,025 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=a5cf4b56498ec7331bb3a0f533d41fc2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:38,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 3b23ebcb7a063fa26cbc8e7ad4af5a30 2023-02-16 18:01:38,025 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676570498025"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676570498025"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676570498025"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676570498025"}]},"ts":"1676570498025"} 2023-02-16 18:01:38,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:38,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3b23ebcb7a063fa26cbc8e7ad4af5a30 2023-02-16 18:01:38,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3b23ebcb7a063fa26cbc8e7ad4af5a30 2023-02-16 18:01:38,027 INFO [StoreOpener-3b23ebcb7a063fa26cbc8e7ad4af5a30-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3b23ebcb7a063fa26cbc8e7ad4af5a30 2023-02-16 18:01:38,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:38,028 DEBUG [StoreOpener-3b23ebcb7a063fa26cbc8e7ad4af5a30-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/3b23ebcb7a063fa26cbc8e7ad4af5a30/f1 2023-02-16 18:01:38,028 DEBUG [StoreOpener-3b23ebcb7a063fa26cbc8e7ad4af5a30-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/3b23ebcb7a063fa26cbc8e7ad4af5a30/f1 2023-02-16 18:01:38,028 INFO [StoreOpener-3b23ebcb7a063fa26cbc8e7ad4af5a30-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3b23ebcb7a063fa26cbc8e7ad4af5a30 columnFamilyName f1 2023-02-16 18:01:38,028 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=17 2023-02-16 18:01:38,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 86f2541ba97be80de5233420d382624d 2023-02-16 18:01:38,029 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=17, state=SUCCESS; OpenRegionProcedure a5cf4b56498ec7331bb3a0f533d41fc2, server=jenkins-hbase4.apache.org,36643,1676570495876 in 170 msec 2023-02-16 18:01:38,029 INFO [StoreOpener-3b23ebcb7a063fa26cbc8e7ad4af5a30-1] regionserver.HStore(310): Store=3b23ebcb7a063fa26cbc8e7ad4af5a30/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:38,029 INFO [StoreOpener-3b23ebcb7a063fa26cbc8e7ad4af5a30-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3b23ebcb7a063fa26cbc8e7ad4af5a30 2023-02-16 18:01:38,030 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a5cf4b56498ec7331bb3a0f533d41fc2, ASSIGN in 341 msec 2023-02-16 18:01:38,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/86f2541ba97be80de5233420d382624d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:38,033 DEBUG [StoreOpener-3b23ebcb7a063fa26cbc8e7ad4af5a30-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/3b23ebcb7a063fa26cbc8e7ad4af5a30/f2 2023-02-16 18:01:38,033 DEBUG [StoreOpener-3b23ebcb7a063fa26cbc8e7ad4af5a30-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/3b23ebcb7a063fa26cbc8e7ad4af5a30/f2 2023-02-16 18:01:38,033 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 86f2541ba97be80de5233420d382624d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71189476, jitterRate=0.06080585718154907}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:38,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 86f2541ba97be80de5233420d382624d: 2023-02-16 18:01:38,034 INFO [StoreOpener-3b23ebcb7a063fa26cbc8e7ad4af5a30-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3b23ebcb7a063fa26cbc8e7ad4af5a30 columnFamilyName f2 2023-02-16 18:01:38,034 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d., pid=27, masterSystemTime=1676570498015 2023-02-16 18:01:38,034 INFO [StoreOpener-3b23ebcb7a063fa26cbc8e7ad4af5a30-1] regionserver.HStore(310): Store=3b23ebcb7a063fa26cbc8e7ad4af5a30/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:38,035 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/3b23ebcb7a063fa26cbc8e7ad4af5a30 2023-02-16 18:01:38,035 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/3b23ebcb7a063fa26cbc8e7ad4af5a30 2023-02-16 18:01:38,035 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d. 2023-02-16 18:01:38,035 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d. 2023-02-16 18:01:38,036 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5. 2023-02-16 18:01:38,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 92a7db0f18e3fd67d4c8e3c9b1bf61e5, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-16 18:01:38,036 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=86f2541ba97be80de5233420d382624d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:38,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 92a7db0f18e3fd67d4c8e3c9b1bf61e5 2023-02-16 18:01:38,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:38,036 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676570498036"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676570498036"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676570498036"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676570498036"}]},"ts":"1676570498036"} 2023-02-16 18:01:38,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 92a7db0f18e3fd67d4c8e3c9b1bf61e5 2023-02-16 18:01:38,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 92a7db0f18e3fd67d4c8e3c9b1bf61e5 2023-02-16 18:01:38,037 INFO [StoreOpener-92a7db0f18e3fd67d4c8e3c9b1bf61e5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 92a7db0f18e3fd67d4c8e3c9b1bf61e5 2023-02-16 18:01:38,039 DEBUG [StoreOpener-92a7db0f18e3fd67d4c8e3c9b1bf61e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/f1 2023-02-16 18:01:38,039 DEBUG [StoreOpener-92a7db0f18e3fd67d4c8e3c9b1bf61e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/f1 2023-02-16 18:01:38,039 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=20 2023-02-16 18:01:38,039 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=20, state=SUCCESS; OpenRegionProcedure 86f2541ba97be80de5233420d382624d, server=jenkins-hbase4.apache.org,35421,1676570495840 in 174 msec 2023-02-16 18:01:38,039 INFO [StoreOpener-92a7db0f18e3fd67d4c8e3c9b1bf61e5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92a7db0f18e3fd67d4c8e3c9b1bf61e5 columnFamilyName f1 2023-02-16 18:01:38,039 INFO [StoreOpener-92a7db0f18e3fd67d4c8e3c9b1bf61e5-1] regionserver.HStore(310): Store=92a7db0f18e3fd67d4c8e3c9b1bf61e5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:38,040 INFO [StoreOpener-92a7db0f18e3fd67d4c8e3c9b1bf61e5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 92a7db0f18e3fd67d4c8e3c9b1bf61e5 2023-02-16 18:01:38,040 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=86f2541ba97be80de5233420d382624d, ASSIGN in 351 msec 2023-02-16 18:01:38,041 DEBUG [StoreOpener-92a7db0f18e3fd67d4c8e3c9b1bf61e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/f2 2023-02-16 18:01:38,041 DEBUG [StoreOpener-92a7db0f18e3fd67d4c8e3c9b1bf61e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/f2 2023-02-16 18:01:38,041 INFO [StoreOpener-92a7db0f18e3fd67d4c8e3c9b1bf61e5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92a7db0f18e3fd67d4c8e3c9b1bf61e5 columnFamilyName f2 2023-02-16 18:01:38,042 INFO [StoreOpener-92a7db0f18e3fd67d4c8e3c9b1bf61e5-1] regionserver.HStore(310): Store=92a7db0f18e3fd67d4c8e3c9b1bf61e5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:38,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5 2023-02-16 18:01:38,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5 2023-02-16 18:01:38,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:38,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 92a7db0f18e3fd67d4c8e3c9b1bf61e5 2023-02-16 18:01:38,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:38,046 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3b23ebcb7a063fa26cbc8e7ad4af5a30 2023-02-16 18:01:38,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:38,047 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 92a7db0f18e3fd67d4c8e3c9b1bf61e5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61847825, jitterRate=-0.07839559018611908}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:38,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 92a7db0f18e3fd67d4c8e3c9b1bf61e5: 2023-02-16 18:01:38,048 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5., pid=30, masterSystemTime=1676570498015 2023-02-16 18:01:38,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/3b23ebcb7a063fa26cbc8e7ad4af5a30/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:38,049 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3b23ebcb7a063fa26cbc8e7ad4af5a30; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67049827, jitterRate=-8.797198534011841E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:38,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3b23ebcb7a063fa26cbc8e7ad4af5a30: 2023-02-16 18:01:38,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5. 2023-02-16 18:01:38,049 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5. 2023-02-16 18:01:38,049 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac. 2023-02-16 18:01:38,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 664fd63b9893f58d619f365d46c359ac, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-16 18:01:38,049 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30., pid=23, masterSystemTime=1676570498007 2023-02-16 18:01:38,049 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=92a7db0f18e3fd67d4c8e3c9b1bf61e5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:38,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 664fd63b9893f58d619f365d46c359ac 2023-02-16 18:01:38,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:38,049 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676570498049"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676570498049"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676570498049"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676570498049"}]},"ts":"1676570498049"} 2023-02-16 18:01:38,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 664fd63b9893f58d619f365d46c359ac 2023-02-16 18:01:38,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 664fd63b9893f58d619f365d46c359ac 2023-02-16 18:01:38,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30. 2023-02-16 18:01:38,051 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30. 2023-02-16 18:01:38,051 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498. 2023-02-16 18:01:38,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => aeef298fd4c8182aec11e6f13fb1f498, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-16 18:01:38,051 INFO [StoreOpener-664fd63b9893f58d619f365d46c359ac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 664fd63b9893f58d619f365d46c359ac 2023-02-16 18:01:38,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion aeef298fd4c8182aec11e6f13fb1f498 2023-02-16 18:01:38,051 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=3b23ebcb7a063fa26cbc8e7ad4af5a30, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:38,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:38,051 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676570498051"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676570498051"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676570498051"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676570498051"}]},"ts":"1676570498051"} 2023-02-16 18:01:38,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for aeef298fd4c8182aec11e6f13fb1f498 2023-02-16 18:01:38,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for aeef298fd4c8182aec11e6f13fb1f498 2023-02-16 18:01:38,052 DEBUG [StoreOpener-664fd63b9893f58d619f365d46c359ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/f1 2023-02-16 18:01:38,052 DEBUG [StoreOpener-664fd63b9893f58d619f365d46c359ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/f1 2023-02-16 18:01:38,052 INFO [StoreOpener-aeef298fd4c8182aec11e6f13fb1f498-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region aeef298fd4c8182aec11e6f13fb1f498 2023-02-16 18:01:38,053 INFO [StoreOpener-664fd63b9893f58d619f365d46c359ac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 664fd63b9893f58d619f365d46c359ac columnFamilyName f1 2023-02-16 18:01:38,053 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=18 2023-02-16 18:01:38,053 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=18, state=SUCCESS; OpenRegionProcedure 92a7db0f18e3fd67d4c8e3c9b1bf61e5, server=jenkins-hbase4.apache.org,35421,1676570495840 in 186 msec 2023-02-16 18:01:38,053 INFO [StoreOpener-664fd63b9893f58d619f365d46c359ac-1] regionserver.HStore(310): Store=664fd63b9893f58d619f365d46c359ac/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:38,053 INFO [StoreOpener-664fd63b9893f58d619f365d46c359ac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 664fd63b9893f58d619f365d46c359ac 2023-02-16 18:01:38,054 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=92a7db0f18e3fd67d4c8e3c9b1bf61e5, ASSIGN in 365 msec 2023-02-16 18:01:38,054 DEBUG [StoreOpener-664fd63b9893f58d619f365d46c359ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/f2 2023-02-16 18:01:38,054 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=11 2023-02-16 18:01:38,054 DEBUG [StoreOpener-664fd63b9893f58d619f365d46c359ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/f2 2023-02-16 18:01:38,055 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=11, state=SUCCESS; OpenRegionProcedure 3b23ebcb7a063fa26cbc8e7ad4af5a30, server=jenkins-hbase4.apache.org,36643,1676570495876 in 197 msec 2023-02-16 18:01:38,055 INFO [StoreOpener-664fd63b9893f58d619f365d46c359ac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 664fd63b9893f58d619f365d46c359ac columnFamilyName f2 2023-02-16 18:01:38,055 DEBUG [StoreOpener-aeef298fd4c8182aec11e6f13fb1f498-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/f1 2023-02-16 18:01:38,055 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3b23ebcb7a063fa26cbc8e7ad4af5a30, ASSIGN in 367 msec 2023-02-16 18:01:38,055 DEBUG [StoreOpener-aeef298fd4c8182aec11e6f13fb1f498-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/f1 2023-02-16 18:01:38,055 INFO [StoreOpener-664fd63b9893f58d619f365d46c359ac-1] regionserver.HStore(310): Store=664fd63b9893f58d619f365d46c359ac/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:38,056 INFO [StoreOpener-aeef298fd4c8182aec11e6f13fb1f498-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aeef298fd4c8182aec11e6f13fb1f498 columnFamilyName f1 2023-02-16 18:01:38,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac 2023-02-16 18:01:38,056 INFO [StoreOpener-aeef298fd4c8182aec11e6f13fb1f498-1] regionserver.HStore(310): Store=aeef298fd4c8182aec11e6f13fb1f498/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:38,056 INFO [StoreOpener-aeef298fd4c8182aec11e6f13fb1f498-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region aeef298fd4c8182aec11e6f13fb1f498 2023-02-16 18:01:38,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac 2023-02-16 18:01:38,057 DEBUG [StoreOpener-aeef298fd4c8182aec11e6f13fb1f498-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/f2 2023-02-16 18:01:38,057 DEBUG [StoreOpener-aeef298fd4c8182aec11e6f13fb1f498-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/f2 2023-02-16 18:01:38,057 INFO [StoreOpener-aeef298fd4c8182aec11e6f13fb1f498-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aeef298fd4c8182aec11e6f13fb1f498 columnFamilyName f2 2023-02-16 18:01:38,058 INFO [StoreOpener-aeef298fd4c8182aec11e6f13fb1f498-1] regionserver.HStore(310): Store=aeef298fd4c8182aec11e6f13fb1f498/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:38,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:38,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498 2023-02-16 18:01:38,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498 2023-02-16 18:01:38,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 664fd63b9893f58d619f365d46c359ac 2023-02-16 18:01:38,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:38,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:38,061 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 664fd63b9893f58d619f365d46c359ac; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72484225, jitterRate=0.08009912073612213}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:38,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 664fd63b9893f58d619f365d46c359ac: 2023-02-16 18:01:38,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for aeef298fd4c8182aec11e6f13fb1f498 2023-02-16 18:01:38,062 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac., pid=26, masterSystemTime=1676570498015 2023-02-16 18:01:38,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac. 2023-02-16 18:01:38,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:38,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac. 2023-02-16 18:01:38,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f. 2023-02-16 18:01:38,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 95c95ff4a3c7bc5bf657c871bd52be7f, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-16 18:01:38,063 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=664fd63b9893f58d619f365d46c359ac, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:38,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 95c95ff4a3c7bc5bf657c871bd52be7f 2023-02-16 18:01:38,063 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676570498063"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676570498063"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676570498063"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676570498063"}]},"ts":"1676570498063"} 2023-02-16 18:01:38,064 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened aeef298fd4c8182aec11e6f13fb1f498; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72146862, jitterRate=0.0750720202922821}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:38,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:38,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for aeef298fd4c8182aec11e6f13fb1f498: 2023-02-16 18:01:38,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 95c95ff4a3c7bc5bf657c871bd52be7f 2023-02-16 18:01:38,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 95c95ff4a3c7bc5bf657c871bd52be7f 2023-02-16 18:01:38,064 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498., pid=22, masterSystemTime=1676570498007 2023-02-16 18:01:38,065 INFO [StoreOpener-95c95ff4a3c7bc5bf657c871bd52be7f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 95c95ff4a3c7bc5bf657c871bd52be7f 2023-02-16 18:01:38,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498. 2023-02-16 18:01:38,066 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498. 2023-02-16 18:01:38,066 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9. 2023-02-16 18:01:38,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 777832e7eb6d1f4669aed8cac8c2cce9, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-16 18:01:38,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 777832e7eb6d1f4669aed8cac8c2cce9 2023-02-16 18:01:38,066 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=aeef298fd4c8182aec11e6f13fb1f498, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:38,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:38,066 DEBUG [StoreOpener-95c95ff4a3c7bc5bf657c871bd52be7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/f1 2023-02-16 18:01:38,066 DEBUG [StoreOpener-95c95ff4a3c7bc5bf657c871bd52be7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/f1 2023-02-16 18:01:38,066 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676570498066"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676570498066"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676570498066"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676570498066"}]},"ts":"1676570498066"} 2023-02-16 18:01:38,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 777832e7eb6d1f4669aed8cac8c2cce9 2023-02-16 18:01:38,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 777832e7eb6d1f4669aed8cac8c2cce9 2023-02-16 18:01:38,067 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=15 2023-02-16 18:01:38,067 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=15, state=SUCCESS; OpenRegionProcedure 664fd63b9893f58d619f365d46c359ac, server=jenkins-hbase4.apache.org,35421,1676570495840 in 204 msec 2023-02-16 18:01:38,067 INFO [StoreOpener-95c95ff4a3c7bc5bf657c871bd52be7f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 95c95ff4a3c7bc5bf657c871bd52be7f columnFamilyName f1 2023-02-16 18:01:38,067 INFO [StoreOpener-95c95ff4a3c7bc5bf657c871bd52be7f-1] regionserver.HStore(310): Store=95c95ff4a3c7bc5bf657c871bd52be7f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:38,068 INFO [StoreOpener-95c95ff4a3c7bc5bf657c871bd52be7f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 95c95ff4a3c7bc5bf657c871bd52be7f 2023-02-16 18:01:38,069 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=664fd63b9893f58d619f365d46c359ac, ASSIGN in 379 msec 2023-02-16 18:01:38,069 DEBUG [StoreOpener-95c95ff4a3c7bc5bf657c871bd52be7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/f2 2023-02-16 18:01:38,069 DEBUG [StoreOpener-95c95ff4a3c7bc5bf657c871bd52be7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/f2 2023-02-16 18:01:38,069 INFO [StoreOpener-95c95ff4a3c7bc5bf657c871bd52be7f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 95c95ff4a3c7bc5bf657c871bd52be7f columnFamilyName f2 2023-02-16 18:01:38,070 INFO [StoreOpener-95c95ff4a3c7bc5bf657c871bd52be7f-1] regionserver.HStore(310): Store=95c95ff4a3c7bc5bf657c871bd52be7f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:38,070 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=14 2023-02-16 18:01:38,070 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=14, state=SUCCESS; OpenRegionProcedure aeef298fd4c8182aec11e6f13fb1f498, server=jenkins-hbase4.apache.org,36643,1676570495876 in 213 msec 2023-02-16 18:01:38,071 INFO [StoreOpener-777832e7eb6d1f4669aed8cac8c2cce9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 777832e7eb6d1f4669aed8cac8c2cce9 2023-02-16 18:01:38,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f 2023-02-16 18:01:38,071 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=aeef298fd4c8182aec11e6f13fb1f498, ASSIGN in 382 msec 2023-02-16 18:01:38,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f 2023-02-16 18:01:38,072 DEBUG [StoreOpener-777832e7eb6d1f4669aed8cac8c2cce9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/f1 2023-02-16 18:01:38,072 DEBUG [StoreOpener-777832e7eb6d1f4669aed8cac8c2cce9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/f1 2023-02-16 18:01:38,072 INFO [StoreOpener-777832e7eb6d1f4669aed8cac8c2cce9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 777832e7eb6d1f4669aed8cac8c2cce9 columnFamilyName f1 2023-02-16 18:01:38,073 INFO [StoreOpener-777832e7eb6d1f4669aed8cac8c2cce9-1] regionserver.HStore(310): Store=777832e7eb6d1f4669aed8cac8c2cce9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:38,073 INFO [StoreOpener-777832e7eb6d1f4669aed8cac8c2cce9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 777832e7eb6d1f4669aed8cac8c2cce9 2023-02-16 18:01:38,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:38,074 DEBUG [StoreOpener-777832e7eb6d1f4669aed8cac8c2cce9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/f2 2023-02-16 18:01:38,074 DEBUG [StoreOpener-777832e7eb6d1f4669aed8cac8c2cce9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/f2 2023-02-16 18:01:38,074 INFO [StoreOpener-777832e7eb6d1f4669aed8cac8c2cce9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 777832e7eb6d1f4669aed8cac8c2cce9 columnFamilyName f2 2023-02-16 18:01:38,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 95c95ff4a3c7bc5bf657c871bd52be7f 2023-02-16 18:01:38,075 INFO [StoreOpener-777832e7eb6d1f4669aed8cac8c2cce9-1] regionserver.HStore(310): Store=777832e7eb6d1f4669aed8cac8c2cce9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:38,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9 2023-02-16 18:01:38,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9 2023-02-16 18:01:38,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:38,077 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 95c95ff4a3c7bc5bf657c871bd52be7f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59578514, jitterRate=-0.1122109591960907}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:38,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 95c95ff4a3c7bc5bf657c871bd52be7f: 2023-02-16 18:01:38,077 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f., pid=29, masterSystemTime=1676570498015 2023-02-16 18:01:38,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:38,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f. 2023-02-16 18:01:38,079 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f. 2023-02-16 18:01:38,079 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1676570497226.e7445758c3b995e9c904d54090c0098f. 2023-02-16 18:01:38,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 777832e7eb6d1f4669aed8cac8c2cce9 2023-02-16 18:01:38,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e7445758c3b995e9c904d54090c0098f, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676570497226.e7445758c3b995e9c904d54090c0098f.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-16 18:01:38,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion e7445758c3b995e9c904d54090c0098f 2023-02-16 18:01:38,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676570497226.e7445758c3b995e9c904d54090c0098f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:38,079 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=95c95ff4a3c7bc5bf657c871bd52be7f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:38,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e7445758c3b995e9c904d54090c0098f 2023-02-16 18:01:38,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e7445758c3b995e9c904d54090c0098f 2023-02-16 18:01:38,079 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676570498079"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676570498079"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676570498079"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676570498079"}]},"ts":"1676570498079"} 2023-02-16 18:01:38,080 INFO [StoreOpener-e7445758c3b995e9c904d54090c0098f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e7445758c3b995e9c904d54090c0098f 2023-02-16 18:01:38,082 DEBUG [StoreOpener-e7445758c3b995e9c904d54090c0098f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/f1 2023-02-16 18:01:38,082 DEBUG [StoreOpener-e7445758c3b995e9c904d54090c0098f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/f1 2023-02-16 18:01:38,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:38,082 INFO [StoreOpener-e7445758c3b995e9c904d54090c0098f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e7445758c3b995e9c904d54090c0098f columnFamilyName f1 2023-02-16 18:01:38,082 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=12 2023-02-16 18:01:38,082 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=12, state=SUCCESS; OpenRegionProcedure 95c95ff4a3c7bc5bf657c871bd52be7f, server=jenkins-hbase4.apache.org,35421,1676570495840 in 217 msec 2023-02-16 18:01:38,082 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 777832e7eb6d1f4669aed8cac8c2cce9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68634892, jitterRate=0.02273958921432495}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:38,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 777832e7eb6d1f4669aed8cac8c2cce9: 2023-02-16 18:01:38,082 INFO [StoreOpener-e7445758c3b995e9c904d54090c0098f-1] regionserver.HStore(310): Store=e7445758c3b995e9c904d54090c0098f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:38,083 INFO [StoreOpener-e7445758c3b995e9c904d54090c0098f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e7445758c3b995e9c904d54090c0098f 2023-02-16 18:01:38,083 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9., pid=21, masterSystemTime=1676570498007 2023-02-16 18:01:38,083 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=95c95ff4a3c7bc5bf657c871bd52be7f, ASSIGN in 394 msec 2023-02-16 18:01:38,084 DEBUG [StoreOpener-e7445758c3b995e9c904d54090c0098f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/f2 2023-02-16 18:01:38,084 DEBUG [StoreOpener-e7445758c3b995e9c904d54090c0098f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/f2 2023-02-16 18:01:38,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9. 2023-02-16 18:01:38,084 INFO [StoreOpener-e7445758c3b995e9c904d54090c0098f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e7445758c3b995e9c904d54090c0098f columnFamilyName f2 2023-02-16 18:01:38,084 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9. 2023-02-16 18:01:38,084 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1676570497226.44bd149ba1e4dc457155e72145b92804. 2023-02-16 18:01:38,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 44bd149ba1e4dc457155e72145b92804, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676570497226.44bd149ba1e4dc457155e72145b92804.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-16 18:01:38,084 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=777832e7eb6d1f4669aed8cac8c2cce9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:38,085 INFO [StoreOpener-e7445758c3b995e9c904d54090c0098f-1] regionserver.HStore(310): Store=e7445758c3b995e9c904d54090c0098f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:38,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 44bd149ba1e4dc457155e72145b92804 2023-02-16 18:01:38,085 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676570498084"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676570498084"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676570498084"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676570498084"}]},"ts":"1676570498084"} 2023-02-16 18:01:38,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676570497226.44bd149ba1e4dc457155e72145b92804.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:38,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 44bd149ba1e4dc457155e72145b92804 2023-02-16 18:01:38,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 44bd149ba1e4dc457155e72145b92804 2023-02-16 18:01:38,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f 2023-02-16 18:01:38,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f 2023-02-16 18:01:38,086 INFO [StoreOpener-44bd149ba1e4dc457155e72145b92804-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 44bd149ba1e4dc457155e72145b92804 2023-02-16 18:01:38,087 DEBUG [StoreOpener-44bd149ba1e4dc457155e72145b92804-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/f1 2023-02-16 18:01:38,087 DEBUG [StoreOpener-44bd149ba1e4dc457155e72145b92804-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/f1 2023-02-16 18:01:38,087 INFO [StoreOpener-44bd149ba1e4dc457155e72145b92804-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 44bd149ba1e4dc457155e72145b92804 columnFamilyName f1 2023-02-16 18:01:38,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:38,088 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=19 2023-02-16 18:01:38,088 INFO [StoreOpener-44bd149ba1e4dc457155e72145b92804-1] regionserver.HStore(310): Store=44bd149ba1e4dc457155e72145b92804/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:38,088 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=19, state=SUCCESS; OpenRegionProcedure 777832e7eb6d1f4669aed8cac8c2cce9, server=jenkins-hbase4.apache.org,36643,1676570495876 in 231 msec 2023-02-16 18:01:38,088 INFO [StoreOpener-44bd149ba1e4dc457155e72145b92804-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 44bd149ba1e4dc457155e72145b92804 2023-02-16 18:01:38,089 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=777832e7eb6d1f4669aed8cac8c2cce9, ASSIGN in 400 msec 2023-02-16 18:01:38,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e7445758c3b995e9c904d54090c0098f 2023-02-16 18:01:38,089 DEBUG [StoreOpener-44bd149ba1e4dc457155e72145b92804-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/f2 2023-02-16 18:01:38,089 DEBUG [StoreOpener-44bd149ba1e4dc457155e72145b92804-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/f2 2023-02-16 18:01:38,089 INFO [StoreOpener-44bd149ba1e4dc457155e72145b92804-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 44bd149ba1e4dc457155e72145b92804 columnFamilyName f2 2023-02-16 18:01:38,089 INFO [StoreOpener-44bd149ba1e4dc457155e72145b92804-1] regionserver.HStore(310): Store=44bd149ba1e4dc457155e72145b92804/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:38,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804 2023-02-16 18:01:38,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804 2023-02-16 18:01:38,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:38,091 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e7445758c3b995e9c904d54090c0098f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72243152, jitterRate=0.0765068531036377}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:38,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e7445758c3b995e9c904d54090c0098f: 2023-02-16 18:01:38,091 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1676570497226.e7445758c3b995e9c904d54090c0098f., pid=28, masterSystemTime=1676570498015 2023-02-16 18:01:38,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:38,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1676570497226.e7445758c3b995e9c904d54090c0098f. 2023-02-16 18:01:38,093 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1676570497226.e7445758c3b995e9c904d54090c0098f. 2023-02-16 18:01:38,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 44bd149ba1e4dc457155e72145b92804 2023-02-16 18:01:38,093 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=e7445758c3b995e9c904d54090c0098f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:38,093 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676570497226.e7445758c3b995e9c904d54090c0098f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676570498093"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676570498093"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676570498093"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676570498093"}]},"ts":"1676570498093"} 2023-02-16 18:01:38,097 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=13 2023-02-16 18:01:38,097 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=13, state=SUCCESS; OpenRegionProcedure e7445758c3b995e9c904d54090c0098f, server=jenkins-hbase4.apache.org,35421,1676570495840 in 231 msec 2023-02-16 18:01:38,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:38,098 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 44bd149ba1e4dc457155e72145b92804; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61172319, jitterRate=-0.08846141397953033}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:38,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 44bd149ba1e4dc457155e72145b92804: 2023-02-16 18:01:38,098 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1676570497226.44bd149ba1e4dc457155e72145b92804., pid=25, masterSystemTime=1676570498007 2023-02-16 18:01:38,098 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e7445758c3b995e9c904d54090c0098f, ASSIGN in 409 msec 2023-02-16 18:01:38,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1676570497226.44bd149ba1e4dc457155e72145b92804. 2023-02-16 18:01:38,100 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1676570497226.44bd149ba1e4dc457155e72145b92804. 2023-02-16 18:01:38,100 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=44bd149ba1e4dc457155e72145b92804, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:38,100 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676570497226.44bd149ba1e4dc457155e72145b92804.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676570498100"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676570498100"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676570498100"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676570498100"}]},"ts":"1676570498100"} 2023-02-16 18:01:38,103 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=16 2023-02-16 18:01:38,103 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=16, state=SUCCESS; OpenRegionProcedure 44bd149ba1e4dc457155e72145b92804, server=jenkins-hbase4.apache.org,36643,1676570495876 in 244 msec 2023-02-16 18:01:38,104 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=10 2023-02-16 18:01:38,104 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=44bd149ba1e4dc457155e72145b92804, ASSIGN in 415 msec 2023-02-16 18:01:38,105 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 18:01:38,106 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676570498106"}]},"ts":"1676570498106"} 2023-02-16 18:01:38,107 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-16 18:01:38,110 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 18:01:38,112 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 884 msec 2023-02-16 18:01:38,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 18:01:38,336 INFO [Listener at localhost/34831] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-16 18:01:38,336 DEBUG [Listener at localhost/34831] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-16 18:01:38,336 INFO [Listener at localhost/34831] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 18:01:38,339 INFO [Listener at localhost/34831] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-16 18:01:38,339 INFO [Listener at localhost/34831] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 18:01:38,339 INFO [Listener at localhost/34831] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-16 18:01:38,339 INFO [Listener at localhost/34831] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-16 18:01:38,372 DEBUG [hconnection-0x7c8a5209-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 18:01:38,385 INFO [RS-EventLoopGroup-13-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32878, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 18:01:38,390 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36643] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498. 2023-02-16 18:01:38,392 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35421] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f. 2023-02-16 18:01:38,456 INFO [Listener at localhost/34831] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-16 18:01:38,456 INFO [Listener at localhost/34831] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-16 18:01:38,458 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-16 18:01:38,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676570498458 (current time:1676570498458). 2023-02-16 18:01:38,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-16 18:01:38,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] zookeeper.ReadOnlyZKClient(139): Connect 0x6e057005 to 127.0.0.1:54761 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 18:01:38,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62349df9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 18:01:38,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 18:01:38,470 INFO [RS-EventLoopGroup-14-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55030, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 18:01:38,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6e057005 to 127.0.0.1:54761 2023-02-16 18:01:38,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:38,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-16 18:01:38,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-16 18:01:38,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-16 18:01:38,476 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-16 18:01:38,478 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676571098478 2023-02-16 18:01:38,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-16 18:01:38,478 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-16 18:01:38,480 DEBUG [Listener at localhost/34831] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-16 18:01:38,481 DEBUG [Listener at localhost/34831] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-16 18:01:38,481 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-16 18:01:38,482 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-16 18:01:38,483 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 8 msec 2023-02-16 18:01:38,484 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-16 18:01:38,485 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1676571098485 2023-02-16 18:01:38,511 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-16 18:01:38,511 INFO [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-16 18:01:38,511 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 18:01:38,512 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-16 18:01:38,512 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-16 18:01:38,581 DEBUG [Listener at localhost/34831] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 18:01:38,583 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:38,583 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:38,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-16 18:01:38,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-16 18:01:38,584 DEBUG [Listener at localhost/34831] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-16 18:01:38,584 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:38,584 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:36643-0x1005e4b74cd0002, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 18:01:38,584 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:35421-0x1005e4b74cd0001, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 18:01:38,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 18:01:38,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:38,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 18:01:38,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:38,585 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:38,585 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:38,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:38,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:38,585 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:38,585 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 18:01:38,585 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36643-0x1005e4b74cd0002, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:38,586 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35421-0x1005e4b74cd0001, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:38,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-16 18:01:38,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:38,586 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-16 18:01:38,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-16 18:01:38,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:38,586 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-16 18:01:38,586 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-16 18:01:38,586 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-16 18:01:38,586 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-16 18:01:38,586 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 18:01:38,586 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-16 18:01:38,586 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 18:01:38,589 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-16 18:01:38,589 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-16 18:01:38,589 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-16 18:01:38,589 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-16 18:01:38,589 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36643,1676570495876' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-16 18:01:38,589 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35421,1676570495840' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-16 18:01:38,591 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:38,591 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:38,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:38,591 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:38,591 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:38,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:38,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 18:01:38,591 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35421-0x1005e4b74cd0001, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:38,591 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 18:01:38,591 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36643-0x1005e4b74cd0002, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:38,591 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 18:01:38,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:38,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:38,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 18:01:38,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:38,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:38,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:38,593 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35421,1676570495840' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-16 18:01:38,593 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23e4505e[Count = 1] remaining members to acquire global barrier 2023-02-16 18:01:38,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:38,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:38,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 18:01:38,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:38,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:38,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 18:01:38,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:38,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:38,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:38,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36643,1676570495876' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-16 18:01:38,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23e4505e[Count = 0] remaining members to acquire global barrier 2023-02-16 18:01:38,594 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-16 18:01:38,594 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:38,596 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:35421-0x1005e4b74cd0001, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:38,596 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:36643-0x1005e4b74cd0002, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:38,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:38,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:38,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:38,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:38,596 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-16 18:01:38,596 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-16 18:01:38,596 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:38,596 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:38,596 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 18:01:38,600 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d. 2023-02-16 18:01:38,600 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d. started... 2023-02-16 18:01:38,600 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30. 2023-02-16 18:01:38,600 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676570497226.44bd149ba1e4dc457155e72145b92804. 2023-02-16 18:01:38,600 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30. started... 2023-02-16 18:01:38,601 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-16 18:01:38,603 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 18:01:38,601 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 86f2541ba97be80de5233420d382624d: 2023-02-16 18:01:38,603 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676570497226.44bd149ba1e4dc457155e72145b92804. started... 2023-02-16 18:01:38,603 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498. 2023-02-16 18:01:38,603 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498. started... 2023-02-16 18:01:38,604 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:38,603 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676570497226.e7445758c3b995e9c904d54090c0098f. 2023-02-16 18:01:38,608 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 44bd149ba1e4dc457155e72145b92804 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 18:01:38,608 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 3b23ebcb7a063fa26cbc8e7ad4af5a30: 2023-02-16 18:01:38,608 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 18:01:38,608 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-16 18:01:38,609 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 18:01:38,609 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676570497226.e7445758c3b995e9c904d54090c0098f. started... 2023-02-16 18:01:38,608 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac. 2023-02-16 18:01:38,608 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-2] regionserver.HRegion(2744): Flushing aeef298fd4c8182aec11e6f13fb1f498 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 18:01:38,610 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac. started... 2023-02-16 18:01:38,609 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-1] regionserver.HRegion(2744): Flushing e7445758c3b995e9c904d54090c0098f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 18:01:38,609 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 18:01:38,609 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:38,609 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 18:01:38,610 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 664fd63b9893f58d619f365d46c359ac 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 18:01:38,611 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 18:01:38,611 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 18:01:38,611 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 18:01:38,625 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d. completed. 2023-02-16 18:01:38,625 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d. 2023-02-16 18:01:38,625 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f. 2023-02-16 18:01:38,625 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-16 18:01:38,625 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f. started... 2023-02-16 18:01:38,626 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 95c95ff4a3c7bc5bf657c871bd52be7f 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-16 18:01:38,628 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/.tmp/f1/f2bcebb4056a472fa6d9cebcc67855d9 2023-02-16 18:01:38,632 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/.tmp/f1/b696f8c059374a7ea689c53bc7e676b5 2023-02-16 18:01:38,640 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/.tmp/f1/f217d5e2b18e4c61872954e6363cc73f 2023-02-16 18:01:38,657 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/.tmp/f2/1a567472d75b41d3a7b2c433da099db1 2023-02-16 18:01:38,659 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/.tmp/f2/4704e763606846cd9f9cf7301d58ace2 2023-02-16 18:01:38,663 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/.tmp/f1/f2bcebb4056a472fa6d9cebcc67855d9 as hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/f1/f2bcebb4056a472fa6d9cebcc67855d9 2023-02-16 18:01:38,664 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/.tmp/f2/e2d3fc77d5bc4d5fbf5a119e083fd48e 2023-02-16 18:01:38,665 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/.tmp/f1/b696f8c059374a7ea689c53bc7e676b5 as hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/f1/b696f8c059374a7ea689c53bc7e676b5 2023-02-16 18:01:38,668 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/f1/f2bcebb4056a472fa6d9cebcc67855d9, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 18:01:38,669 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/.tmp/f2/1a567472d75b41d3a7b2c433da099db1 as hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/f2/1a567472d75b41d3a7b2c433da099db1 2023-02-16 18:01:38,670 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/f1/b696f8c059374a7ea689c53bc7e676b5, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 18:01:38,671 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/.tmp/f1/f217d5e2b18e4c61872954e6363cc73f as hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/f1/f217d5e2b18e4c61872954e6363cc73f 2023-02-16 18:01:38,672 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/.tmp/f2/4704e763606846cd9f9cf7301d58ace2 as hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/f2/4704e763606846cd9f9cf7301d58ace2 2023-02-16 18:01:38,674 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/f2/1a567472d75b41d3a7b2c433da099db1, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 18:01:38,675 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 664fd63b9893f58d619f365d46c359ac in 65ms, sequenceid=5, compaction requested=false 2023-02-16 18:01:38,675 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-16 18:01:38,675 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 664fd63b9893f58d619f365d46c359ac: 2023-02-16 18:01:38,676 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:38,676 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 18:01:38,676 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/f1/f2bcebb4056a472fa6d9cebcc67855d9] hfiles 2023-02-16 18:01:38,676 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/f1/f2bcebb4056a472fa6d9cebcc67855d9 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:38,677 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/f2/1a567472d75b41d3a7b2c433da099db1] hfiles 2023-02-16 18:01:38,677 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/f2/1a567472d75b41d3a7b2c433da099db1 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:38,677 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/f1/f217d5e2b18e4c61872954e6363cc73f, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 18:01:38,677 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/f2/4704e763606846cd9f9cf7301d58ace2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 18:01:38,678 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/.tmp/f2/e2d3fc77d5bc4d5fbf5a119e083fd48e as hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/f2/e2d3fc77d5bc4d5fbf5a119e083fd48e 2023-02-16 18:01:38,678 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for e7445758c3b995e9c904d54090c0098f in 69ms, sequenceid=5, compaction requested=false 2023-02-16 18:01:38,679 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for e7445758c3b995e9c904d54090c0098f: 2023-02-16 18:01:38,680 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676570497226.e7445758c3b995e9c904d54090c0098f.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:38,680 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 18:01:38,680 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/f1/b696f8c059374a7ea689c53bc7e676b5] hfiles 2023-02-16 18:01:38,680 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/f1/b696f8c059374a7ea689c53bc7e676b5 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:38,680 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/f2/4704e763606846cd9f9cf7301d58ace2] hfiles 2023-02-16 18:01:38,680 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/f2/4704e763606846cd9f9cf7301d58ace2 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:38,690 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/f2/e2d3fc77d5bc4d5fbf5a119e083fd48e, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 18:01:38,691 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 95c95ff4a3c7bc5bf657c871bd52be7f in 65ms, sequenceid=5, compaction requested=false 2023-02-16 18:01:38,691 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 95c95ff4a3c7bc5bf657c871bd52be7f: 2023-02-16 18:01:38,691 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac. completed. 2023-02-16 18:01:38,691 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:38,691 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac. 2023-02-16 18:01:38,691 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 18:01:38,691 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-16 18:01:38,691 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/f1/f217d5e2b18e4c61872954e6363cc73f] hfiles 2023-02-16 18:01:38,691 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5. 2023-02-16 18:01:38,691 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/f1/f217d5e2b18e4c61872954e6363cc73f for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:38,691 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5. started... 2023-02-16 18:01:38,691 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/f2/e2d3fc77d5bc4d5fbf5a119e083fd48e] hfiles 2023-02-16 18:01:38,691 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/f2/e2d3fc77d5bc4d5fbf5a119e083fd48e for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:38,692 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 92a7db0f18e3fd67d4c8e3c9b1bf61e5 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 18:01:38,696 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676570497226.e7445758c3b995e9c904d54090c0098f. completed. 2023-02-16 18:01:38,696 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676570497226.e7445758c3b995e9c904d54090c0098f. 2023-02-16 18:01:38,696 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-16 18:01:38,705 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f. completed. 2023-02-16 18:01:38,705 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f. 2023-02-16 18:01:38,705 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-16 18:01:38,710 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/.tmp/f1/e0d1060699f74c0e830c6d64b3bbe17a 2023-02-16 18:01:38,723 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/.tmp/f2/aa5b86b42566427db950eeacfba9a9f8 2023-02-16 18:01:38,726 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/.tmp/f1/e0d1060699f74c0e830c6d64b3bbe17a as hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/f1/e0d1060699f74c0e830c6d64b3bbe17a 2023-02-16 18:01:38,734 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/f1/e0d1060699f74c0e830c6d64b3bbe17a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 18:01:38,734 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/.tmp/f2/aa5b86b42566427db950eeacfba9a9f8 as hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/f2/aa5b86b42566427db950eeacfba9a9f8 2023-02-16 18:01:38,738 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/f2/aa5b86b42566427db950eeacfba9a9f8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 18:01:38,739 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 92a7db0f18e3fd67d4c8e3c9b1bf61e5 in 47ms, sequenceid=5, compaction requested=false 2023-02-16 18:01:38,739 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 92a7db0f18e3fd67d4c8e3c9b1bf61e5: 2023-02-16 18:01:38,739 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:38,739 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 18:01:38,739 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/f1/e0d1060699f74c0e830c6d64b3bbe17a] hfiles 2023-02-16 18:01:38,740 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/f1/e0d1060699f74c0e830c6d64b3bbe17a for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:38,740 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/f2/aa5b86b42566427db950eeacfba9a9f8] hfiles 2023-02-16 18:01:38,740 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/f2/aa5b86b42566427db950eeacfba9a9f8 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:38,749 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5. completed. 2023-02-16 18:01:38,749 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5. 2023-02-16 18:01:38,749 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-16 18:01:38,750 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-16 18:01:38,750 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:38,750 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-16 18:01:38,750 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,35421,1676570495840' in zk 2023-02-16 18:01:38,752 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-16 18:01:38,752 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:38,753 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:38,753 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-16 18:01:38,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:38,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:38,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 18:01:38,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:38,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:38,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 18:01:38,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:38,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:38,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:38,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 18:01:38,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:38,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,35421,1676570495840': 2023-02-16 18:01:38,758 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35421,1676570495840' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-16 18:01:38,785 DEBUG [Listener at localhost/34831] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 18:01:38,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-16 18:01:38,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-16 18:01:38,786 DEBUG [Listener at localhost/34831] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-16 18:01:39,026 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30. completed. 2023-02-16 18:01:39,026 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30. 2023-02-16 18:01:39,026 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/.tmp/f1/8fda2e6ded084e99be0199b3b806769a 2023-02-16 18:01:39,026 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9. 2023-02-16 18:01:39,026 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-16 18:01:39,026 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9. started... 2023-02-16 18:01:39,027 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 777832e7eb6d1f4669aed8cac8c2cce9 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-16 18:01:39,031 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/.tmp/f1/6fbb1eaa05d6417d954d7862b2682f1e 2023-02-16 18:01:39,040 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/.tmp/f1/53fb3d5d19694c9b906cae37ddda4fe9 2023-02-16 18:01:39,046 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/.tmp/f2/5b29df03dcf2498ab4012e6e1ad86415 2023-02-16 18:01:39,050 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/.tmp/f1/8fda2e6ded084e99be0199b3b806769a as hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/f1/8fda2e6ded084e99be0199b3b806769a 2023-02-16 18:01:39,056 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/.tmp/f2/b8f6d8a77d4943a0a88ed4633a7af8f8 2023-02-16 18:01:39,057 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/f1/8fda2e6ded084e99be0199b3b806769a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 18:01:39,058 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/.tmp/f2/5b29df03dcf2498ab4012e6e1ad86415 as hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/f2/5b29df03dcf2498ab4012e6e1ad86415 2023-02-16 18:01:39,060 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/.tmp/f2/f58c8230c8a14d33907c5a9430d691ae 2023-02-16 18:01:39,061 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/.tmp/f1/6fbb1eaa05d6417d954d7862b2682f1e as hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/f1/6fbb1eaa05d6417d954d7862b2682f1e 2023-02-16 18:01:39,068 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/f2/5b29df03dcf2498ab4012e6e1ad86415, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 18:01:39,069 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 44bd149ba1e4dc457155e72145b92804 in 461ms, sequenceid=5, compaction requested=false 2023-02-16 18:01:39,069 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 44bd149ba1e4dc457155e72145b92804: 2023-02-16 18:01:39,069 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676570497226.44bd149ba1e4dc457155e72145b92804.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,070 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 18:01:39,070 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/f1/8fda2e6ded084e99be0199b3b806769a] hfiles 2023-02-16 18:01:39,070 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/f1/8fda2e6ded084e99be0199b3b806769a for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,070 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/f2/5b29df03dcf2498ab4012e6e1ad86415] hfiles 2023-02-16 18:01:39,070 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/f2/5b29df03dcf2498ab4012e6e1ad86415 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,071 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/f1/6fbb1eaa05d6417d954d7862b2682f1e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 18:01:39,072 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/.tmp/f2/b8f6d8a77d4943a0a88ed4633a7af8f8 as hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/f2/b8f6d8a77d4943a0a88ed4633a7af8f8 2023-02-16 18:01:39,073 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/.tmp/f1/53fb3d5d19694c9b906cae37ddda4fe9 as hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/f1/53fb3d5d19694c9b906cae37ddda4fe9 2023-02-16 18:01:39,077 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/f2/b8f6d8a77d4943a0a88ed4633a7af8f8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 18:01:39,077 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for aeef298fd4c8182aec11e6f13fb1f498 in 469ms, sequenceid=5, compaction requested=false 2023-02-16 18:01:39,078 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for aeef298fd4c8182aec11e6f13fb1f498: 2023-02-16 18:01:39,078 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,078 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 18:01:39,078 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/f1/6fbb1eaa05d6417d954d7862b2682f1e] hfiles 2023-02-16 18:01:39,078 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/f1/6fbb1eaa05d6417d954d7862b2682f1e for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,078 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/f2/b8f6d8a77d4943a0a88ed4633a7af8f8] hfiles 2023-02-16 18:01:39,078 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/f2/b8f6d8a77d4943a0a88ed4633a7af8f8 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,086 DEBUG [Listener at localhost/34831] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 18:01:39,086 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/f1/53fb3d5d19694c9b906cae37ddda4fe9, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 18:01:39,087 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/.tmp/f2/f58c8230c8a14d33907c5a9430d691ae as hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/f2/f58c8230c8a14d33907c5a9430d691ae 2023-02-16 18:01:39,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-16 18:01:39,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-16 18:01:39,088 DEBUG [Listener at localhost/34831] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-16 18:01:39,092 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/f2/f58c8230c8a14d33907c5a9430d691ae, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 18:01:39,092 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 777832e7eb6d1f4669aed8cac8c2cce9 in 65ms, sequenceid=5, compaction requested=false 2023-02-16 18:01:39,092 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 777832e7eb6d1f4669aed8cac8c2cce9: 2023-02-16 18:01:39,093 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,093 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 18:01:39,093 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/f1/53fb3d5d19694c9b906cae37ddda4fe9] hfiles 2023-02-16 18:01:39,093 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/f1/53fb3d5d19694c9b906cae37ddda4fe9 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,093 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/f2/f58c8230c8a14d33907c5a9430d691ae] hfiles 2023-02-16 18:01:39,093 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/f2/f58c8230c8a14d33907c5a9430d691ae for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,103 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676570497226.44bd149ba1e4dc457155e72145b92804. completed. 2023-02-16 18:01:39,103 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676570497226.44bd149ba1e4dc457155e72145b92804. 2023-02-16 18:01:39,103 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2. 2023-02-16 18:01:39,103 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-16 18:01:39,104 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2. started... 2023-02-16 18:01:39,105 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-0] regionserver.HRegion(2744): Flushing a5cf4b56498ec7331bb3a0f533d41fc2 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 18:01:39,107 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498. completed. 2023-02-16 18:01:39,107 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498. 2023-02-16 18:01:39,107 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-16 18:01:39,110 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9. completed. 2023-02-16 18:01:39,110 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9. 2023-02-16 18:01:39,110 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-16 18:01:39,117 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/.tmp/f1/05fdf01c312345838cd45c949a7391cf 2023-02-16 18:01:39,129 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/.tmp/f2/52020cbb29a8494f96fe5505251b0bbd 2023-02-16 18:01:39,133 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/.tmp/f1/05fdf01c312345838cd45c949a7391cf as hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/f1/05fdf01c312345838cd45c949a7391cf 2023-02-16 18:01:39,137 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/f1/05fdf01c312345838cd45c949a7391cf, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 18:01:39,137 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/.tmp/f2/52020cbb29a8494f96fe5505251b0bbd as hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/f2/52020cbb29a8494f96fe5505251b0bbd 2023-02-16 18:01:39,142 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/f2/52020cbb29a8494f96fe5505251b0bbd, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 18:01:39,142 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for a5cf4b56498ec7331bb3a0f533d41fc2 in 37ms, sequenceid=5, compaction requested=false 2023-02-16 18:01:39,143 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for a5cf4b56498ec7331bb3a0f533d41fc2: 2023-02-16 18:01:39,143 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,143 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 18:01:39,143 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/f1/05fdf01c312345838cd45c949a7391cf] hfiles 2023-02-16 18:01:39,143 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/f1/05fdf01c312345838cd45c949a7391cf for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,143 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/f2/52020cbb29a8494f96fe5505251b0bbd] hfiles 2023-02-16 18:01:39,143 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/f2/52020cbb29a8494f96fe5505251b0bbd for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,149 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2. completed. 2023-02-16 18:01:39,149 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2. 2023-02-16 18:01:39,149 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-16 18:01:39,149 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-16 18:01:39,149 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:39,149 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-16 18:01:39,149 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,36643,1676570495876' in zk 2023-02-16 18:01:39,153 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-16 18:01:39,153 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:39,153 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:39,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:39,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:39,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 18:01:39,153 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-16 18:01:39,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:39,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:39,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:39,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:39,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:39,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:39,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:39,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,36643,1676570495876': 2023-02-16 18:01:39,158 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36643,1676570495876' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-16 18:01:39,158 INFO [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-16 18:01:39,158 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 18:01:39,158 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 18:01:39,158 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,158 INFO [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-16 18:01:39,160 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:36643-0x1005e4b74cd0002, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,160 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:39,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 18:01:39,160 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:36643-0x1005e4b74cd0002, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 18:01:39,160 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:35421-0x1005e4b74cd0001, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,160 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:35421-0x1005e4b74cd0001, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 18:01:39,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:39,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 18:01:39,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:39,161 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:39,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 18:01:39,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:39,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,161 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:39,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:39,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:39,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:39,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:39,163 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:39,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,163 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:39,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:39,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:39,169 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:39,169 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:36643-0x1005e4b74cd0002, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 18:01:39,169 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:35421-0x1005e4b74cd0001, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 18:01:39,169 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:36643-0x1005e4b74cd0002, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 18:01:39,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 18:01:39,169 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:35421-0x1005e4b74cd0001, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 18:01:39,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 18:01:39,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:39,169 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:39,169 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,169 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:39,169 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,169 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:39,169 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,169 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:39,169 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 18:01:39,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:39,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 18:01:39,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:39,169 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:39,170 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,170 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,170 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,208 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,231 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-16 18:01:39,231 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,231 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,231 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1676570498478Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1676570499169 (+691 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1676570499169Writing data manifest for testWithMockedMapReduceMultiRegion at 1676570499181 (+12 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1676570499194 (+13 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1676570499231 (+37 ms) 2023-02-16 18:01:39,233 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-16 18:01:39,234 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 753 msec 2023-02-16 18:01:39,588 DEBUG [Listener at localhost/34831] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 18:01:39,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-16 18:01:39,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-16 18:01:39,589 INFO [Listener at localhost/34831] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-16 18:01:39,594 INFO [Listener at localhost/34831] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-16 18:01:39,600 INFO [Listener at localhost/34831] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-16 18:01:39,626 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36643] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498. 2023-02-16 18:01:39,697 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35421] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f. 2023-02-16 18:01:39,752 INFO [Listener at localhost/34831] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-16 18:01:39,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-16 18:01:39,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,762 INFO [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-16 18:01:39,762 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 18:01:39,763 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-16 18:01:39,763 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-16 18:01:39,764 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,764 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,765 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:39,765 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:35421-0x1005e4b74cd0001, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 18:01:39,765 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:36643-0x1005e4b74cd0002, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 18:01:39,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 18:01:39,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:39,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 18:01:39,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:39,768 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:39,769 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:39,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,769 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:39,769 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 18:01:39,769 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35421-0x1005e4b74cd0001, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,769 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36643-0x1005e4b74cd0002, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 18:01:39,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 18:01:39,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,770 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,770 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,770 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,770 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,772 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-16 18:01:39,772 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 18:01:39,772 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-16 18:01:39,773 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 18:01:39,773 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-16 18:01:39,773 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-16 18:01:39,774 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676570497226.44bd149ba1e4dc457155e72145b92804. 2023-02-16 18:01:39,774 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1676570497226.44bd149ba1e4dc457155e72145b92804. started... 2023-02-16 18:01:39,774 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 44bd149ba1e4dc457155e72145b92804 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 18:01:39,776 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d. 2023-02-16 18:01:39,776 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30. 2023-02-16 18:01:39,776 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676570497226.e7445758c3b995e9c904d54090c0098f. 2023-02-16 18:01:39,777 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30. started... 2023-02-16 18:01:39,777 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-16 18:01:39,777 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac. 2023-02-16 18:01:39,777 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 3b23ebcb7a063fa26cbc8e7ad4af5a30: 2023-02-16 18:01:39,777 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1676570497226.e7445758c3b995e9c904d54090c0098f. started... 2023-02-16 18:01:39,776 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d. started... 2023-02-16 18:01:39,777 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30. 2023-02-16 18:01:39,777 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing e7445758c3b995e9c904d54090c0098f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 18:01:39,777 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac. started... 2023-02-16 18:01:39,777 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 18:01:39,777 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 664fd63b9893f58d619f365d46c359ac 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 18:01:39,777 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 86f2541ba97be80de5233420d382624d: 2023-02-16 18:01:39,777 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d. 2023-02-16 18:01:39,780 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-16 18:01:39,780 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9. 2023-02-16 18:01:39,780 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498. 2023-02-16 18:01:39,780 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498. started... 2023-02-16 18:01:39,780 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 18:01:39,780 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing aeef298fd4c8182aec11e6f13fb1f498 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 18:01:39,780 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-16 18:01:39,780 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9. started... 2023-02-16 18:01:39,780 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 777832e7eb6d1f4669aed8cac8c2cce9 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-16 18:01:39,784 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f. 2023-02-16 18:01:39,785 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-16 18:01:39,785 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f. started... 2023-02-16 18:01:39,785 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 95c95ff4a3c7bc5bf657c871bd52be7f 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-16 18:01:39,816 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/.tmp/f1/3c79116e915840ff85bec378872d9972 2023-02-16 18:01:39,817 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/.tmp/f1/2d8d3045a8484a54be93d60414bb48cb 2023-02-16 18:01:39,818 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/.tmp/f1/a05d1f2cacdf418b957fabbda5daa5ff 2023-02-16 18:01:39,820 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/.tmp/f1/1ff253032bd944e1966f8febdf302511 2023-02-16 18:01:39,822 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/.tmp/f1/658140234cc74af383ff6d85b2b68bca 2023-02-16 18:01:39,823 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/.tmp/f1/4f64228c50a54343a27264f8ee35bd7f 2023-02-16 18:01:39,853 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/.tmp/f2/0fd0116cbcda4d74b5e495bd7d23e0b1 2023-02-16 18:01:39,859 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/.tmp/f1/3c79116e915840ff85bec378872d9972 as hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/f1/3c79116e915840ff85bec378872d9972 2023-02-16 18:01:39,859 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/.tmp/f2/77eaf2a6636a4984bbeb348cbb29d1a5 2023-02-16 18:01:39,863 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/f1/3c79116e915840ff85bec378872d9972, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 18:01:39,863 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/.tmp/f1/658140234cc74af383ff6d85b2b68bca as hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/f1/658140234cc74af383ff6d85b2b68bca 2023-02-16 18:01:39,864 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/.tmp/f2/0fd0116cbcda4d74b5e495bd7d23e0b1 as hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/f2/0fd0116cbcda4d74b5e495bd7d23e0b1 2023-02-16 18:01:39,868 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/f2/0fd0116cbcda4d74b5e495bd7d23e0b1, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 18:01:39,869 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 95c95ff4a3c7bc5bf657c871bd52be7f in 84ms, sequenceid=9, compaction requested=false 2023-02-16 18:01:39,869 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 95c95ff4a3c7bc5bf657c871bd52be7f: 2023-02-16 18:01:39,869 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f. 2023-02-16 18:01:39,869 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5. 2023-02-16 18:01:39,869 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-16 18:01:39,869 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5. started... 2023-02-16 18:01:39,869 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 92a7db0f18e3fd67d4c8e3c9b1bf61e5 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 18:01:39,874 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/.tmp/f2/3277a1c065dd4847a6ddf33b8f182069 2023-02-16 18:01:39,876 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/f1/658140234cc74af383ff6d85b2b68bca, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 18:01:39,877 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/.tmp/f2/77eaf2a6636a4984bbeb348cbb29d1a5 as hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/f2/77eaf2a6636a4984bbeb348cbb29d1a5 2023-02-16 18:01:39,878 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/.tmp/f2/8b985a15392f43778cd202266696e6b4 2023-02-16 18:01:39,879 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/.tmp/f2/b6c46c22b63d4c8eb0633234bc0ea217 2023-02-16 18:01:39,880 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/.tmp/f1/2d8d3045a8484a54be93d60414bb48cb as hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/f1/2d8d3045a8484a54be93d60414bb48cb 2023-02-16 18:01:39,884 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/f2/77eaf2a6636a4984bbeb348cbb29d1a5, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 18:01:39,885 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/.tmp/f1/4f64228c50a54343a27264f8ee35bd7f as hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/f1/4f64228c50a54343a27264f8ee35bd7f 2023-02-16 18:01:39,885 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/f1/2d8d3045a8484a54be93d60414bb48cb, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 18:01:39,885 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 664fd63b9893f58d619f365d46c359ac in 108ms, sequenceid=9, compaction requested=false 2023-02-16 18:01:39,885 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 664fd63b9893f58d619f365d46c359ac: 2023-02-16 18:01:39,885 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac. 2023-02-16 18:01:39,885 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/.tmp/f1/a05d1f2cacdf418b957fabbda5daa5ff as hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/f1/a05d1f2cacdf418b957fabbda5daa5ff 2023-02-16 18:01:39,885 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-16 18:01:39,886 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/.tmp/f2/3277a1c065dd4847a6ddf33b8f182069 as hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/f2/3277a1c065dd4847a6ddf33b8f182069 2023-02-16 18:01:39,889 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/f1/4f64228c50a54343a27264f8ee35bd7f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 18:01:39,890 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/.tmp/f2/8b985a15392f43778cd202266696e6b4 as hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/f2/8b985a15392f43778cd202266696e6b4 2023-02-16 18:01:39,890 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/.tmp/f2/7e3aea2b9ddf4671bdef89555eb8248f 2023-02-16 18:01:39,890 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/f1/a05d1f2cacdf418b957fabbda5daa5ff, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 18:01:39,891 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/.tmp/f2/b6c46c22b63d4c8eb0633234bc0ea217 as hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/f2/b6c46c22b63d4c8eb0633234bc0ea217 2023-02-16 18:01:39,891 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/f2/3277a1c065dd4847a6ddf33b8f182069, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 18:01:39,892 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 777832e7eb6d1f4669aed8cac8c2cce9 in 112ms, sequenceid=9, compaction requested=false 2023-02-16 18:01:39,892 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 777832e7eb6d1f4669aed8cac8c2cce9: 2023-02-16 18:01:39,892 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9. 2023-02-16 18:01:39,892 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2. 2023-02-16 18:01:39,892 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-16 18:01:39,893 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2. started... 2023-02-16 18:01:39,893 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing a5cf4b56498ec7331bb3a0f533d41fc2 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 18:01:39,893 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/.tmp/f1/0286ece5f4f040c7b4f30eec8332a4e8 2023-02-16 18:01:39,897 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/f2/8b985a15392f43778cd202266696e6b4, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 18:01:39,897 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/f2/b6c46c22b63d4c8eb0633234bc0ea217, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 18:01:39,898 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for e7445758c3b995e9c904d54090c0098f in 121ms, sequenceid=9, compaction requested=false 2023-02-16 18:01:39,898 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 44bd149ba1e4dc457155e72145b92804 in 124ms, sequenceid=9, compaction requested=false 2023-02-16 18:01:39,898 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for e7445758c3b995e9c904d54090c0098f: 2023-02-16 18:01:39,898 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 44bd149ba1e4dc457155e72145b92804: 2023-02-16 18:01:39,898 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676570497226.44bd149ba1e4dc457155e72145b92804. 2023-02-16 18:01:39,898 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676570497226.e7445758c3b995e9c904d54090c0098f. 2023-02-16 18:01:39,898 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-16 18:01:39,898 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-16 18:01:39,902 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/.tmp/f1/1ff253032bd944e1966f8febdf302511 as hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/f1/1ff253032bd944e1966f8febdf302511 2023-02-16 18:01:39,906 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/f1/1ff253032bd944e1966f8febdf302511, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 18:01:39,906 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/.tmp/f2/7e3aea2b9ddf4671bdef89555eb8248f as hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/f2/7e3aea2b9ddf4671bdef89555eb8248f 2023-02-16 18:01:39,916 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/.tmp/f1/38b4ca0894934480b1ac1e7cbb3061ad 2023-02-16 18:01:39,916 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/f2/7e3aea2b9ddf4671bdef89555eb8248f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 18:01:39,917 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for aeef298fd4c8182aec11e6f13fb1f498 in 137ms, sequenceid=9, compaction requested=false 2023-02-16 18:01:39,917 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for aeef298fd4c8182aec11e6f13fb1f498: 2023-02-16 18:01:39,917 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498. 2023-02-16 18:01:39,917 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-16 18:01:39,929 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/.tmp/f2/843e0be78fa143929237dcd1bcb45fe7 2023-02-16 18:01:39,933 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/.tmp/f1/38b4ca0894934480b1ac1e7cbb3061ad as hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/f1/38b4ca0894934480b1ac1e7cbb3061ad 2023-02-16 18:01:39,937 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/f1/38b4ca0894934480b1ac1e7cbb3061ad, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 18:01:39,937 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/.tmp/f2/843e0be78fa143929237dcd1bcb45fe7 as hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/f2/843e0be78fa143929237dcd1bcb45fe7 2023-02-16 18:01:39,941 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/f2/843e0be78fa143929237dcd1bcb45fe7, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 18:01:39,941 INFO [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for a5cf4b56498ec7331bb3a0f533d41fc2 in 48ms, sequenceid=9, compaction requested=false 2023-02-16 18:01:39,942 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for a5cf4b56498ec7331bb3a0f533d41fc2: 2023-02-16 18:01:39,942 DEBUG [rs(jenkins-hbase4.apache.org,36643,1676570495876)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2. 2023-02-16 18:01:39,942 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-16 18:01:39,942 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-16 18:01:39,942 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:39,942 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-16 18:01:39,942 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36643,1676570495876' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-16 18:01:39,944 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,944 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:39,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:39,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:39,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 18:01:39,944 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36643-0x1005e4b74cd0002, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,944 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 18:01:39,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:39,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:39,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 18:01:39,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:39,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:39,946 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36643,1676570495876' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-16 18:01:39,946 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27dbd0fa[Count = 1] remaining members to acquire global barrier 2023-02-16 18:01:40,319 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/.tmp/f2/a9521de6cf3940ac8794a305feb585b0 2023-02-16 18:01:40,324 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/.tmp/f1/0286ece5f4f040c7b4f30eec8332a4e8 as hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/f1/0286ece5f4f040c7b4f30eec8332a4e8 2023-02-16 18:01:40,329 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/f1/0286ece5f4f040c7b4f30eec8332a4e8, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 18:01:40,329 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/.tmp/f2/a9521de6cf3940ac8794a305feb585b0 as hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/f2/a9521de6cf3940ac8794a305feb585b0 2023-02-16 18:01:40,334 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/f2/a9521de6cf3940ac8794a305feb585b0, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 18:01:40,335 INFO [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 92a7db0f18e3fd67d4c8e3c9b1bf61e5 in 466ms, sequenceid=9, compaction requested=false 2023-02-16 18:01:40,335 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 92a7db0f18e3fd67d4c8e3c9b1bf61e5: 2023-02-16 18:01:40,335 DEBUG [rs(jenkins-hbase4.apache.org,35421,1676570495840)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5. 2023-02-16 18:01:40,335 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-16 18:01:40,335 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-16 18:01:40,335 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:40,335 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-16 18:01:40,335 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35421,1676570495840' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-16 18:01:40,337 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:40,337 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:40,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:40,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 18:01:40,337 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35421-0x1005e4b74cd0001, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,337 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 18:01:40,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:40,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:40,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:40,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:40,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:40,340 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35421,1676570495840' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-16 18:01:40,340 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27dbd0fa[Count = 0] remaining members to acquire global barrier 2023-02-16 18:01:40,340 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-16 18:01:40,340 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,343 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:36643-0x1005e4b74cd0002, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,343 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:35421-0x1005e4b74cd0001, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,344 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-16 18:01:40,344 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-16 18:01:40,344 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-16 18:01:40,344 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,35421,1676570495840' in zk 2023-02-16 18:01:40,344 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-16 18:01:40,344 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,36643,1676570495876' in zk 2023-02-16 18:01:40,344 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:40,345 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:40,345 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 18:01:40,345 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-16 18:01:40,345 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:40,345 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:40,345 DEBUG [member: 'jenkins-hbase4.apache.org,35421,1676570495840' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-16 18:01:40,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:40,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:40,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 18:01:40,346 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-16 18:01:40,346 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:40,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:40,346 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:40,346 DEBUG [member: 'jenkins-hbase4.apache.org,36643,1676570495876' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-16 18:01:40,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:40,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:40,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:40,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:40,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:40,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:40,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,35421,1676570495840': 2023-02-16 18:01:40,350 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35421,1676570495840' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-16 18:01:40,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:40,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:40,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 18:01:40,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:40,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:40,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:40,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:40,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:40,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:40,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:40,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,36643,1676570495876': 2023-02-16 18:01:40,354 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36643,1676570495876' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-16 18:01:40,354 INFO [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-16 18:01:40,354 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 18:01:40,354 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 18:01:40,354 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,354 INFO [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-16 18:01:40,356 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,356 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:35421-0x1005e4b74cd0001, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:40,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 18:01:40,356 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:36643-0x1005e4b74cd0002, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,356 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:35421-0x1005e4b74cd0001, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 18:01:40,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,356 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:36643-0x1005e4b74cd0002, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 18:01:40,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:40,357 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:40,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 18:01:40,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:40,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 18:01:40,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:40,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,357 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:40,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:40,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:40,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:40,358 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:40,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:40,359 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:40,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:40,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:40,362 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:40,362 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,362 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:40,362 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:36643-0x1005e4b74cd0002, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 18:01:40,362 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,362 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:35421-0x1005e4b74cd0001, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 18:01:40,362 DEBUG [(jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:40,362 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:40,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 18:01:40,362 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:36643-0x1005e4b74cd0002, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 18:01:40,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:40,362 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 18:01:40,363 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:40,362 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:35421-0x1005e4b74cd0001, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 18:01:40,362 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-16 18:01:40,363 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-16 18:01:40,363 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 18:01:40,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:40,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:40,363 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,363 DEBUG [Listener at localhost/34831] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-16 18:01:40,363 DEBUG [Listener at localhost/34831] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-16 18:01:40,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 18:01:40,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:40,463 DEBUG [Listener at localhost/34831] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-16 18:01:40,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-16 18:01:40,469 INFO [Listener at localhost/34831] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676570498458 type: FLUSH version: 2 ttl: 0 2023-02-16 18:01:40,469 DEBUG [Listener at localhost/34831] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2/data/default/testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,470 INFO [Listener at localhost/34831] snapshot.RestoreSnapshotHelper(239): region to add: 86f2541ba97be80de5233420d382624d 2023-02-16 18:01:40,470 INFO [Listener at localhost/34831] snapshot.RestoreSnapshotHelper(239): region to add: 44bd149ba1e4dc457155e72145b92804 2023-02-16 18:01:40,470 INFO [Listener at localhost/34831] snapshot.RestoreSnapshotHelper(239): region to add: e7445758c3b995e9c904d54090c0098f 2023-02-16 18:01:40,470 INFO [Listener at localhost/34831] snapshot.RestoreSnapshotHelper(239): region to add: 3b23ebcb7a063fa26cbc8e7ad4af5a30 2023-02-16 18:01:40,470 INFO [Listener at localhost/34831] snapshot.RestoreSnapshotHelper(239): region to add: 664fd63b9893f58d619f365d46c359ac 2023-02-16 18:01:40,470 INFO [Listener at localhost/34831] snapshot.RestoreSnapshotHelper(239): region to add: aeef298fd4c8182aec11e6f13fb1f498 2023-02-16 18:01:40,470 INFO [Listener at localhost/34831] snapshot.RestoreSnapshotHelper(239): region to add: 95c95ff4a3c7bc5bf657c871bd52be7f 2023-02-16 18:01:40,470 INFO [Listener at localhost/34831] snapshot.RestoreSnapshotHelper(239): region to add: 777832e7eb6d1f4669aed8cac8c2cce9 2023-02-16 18:01:40,470 INFO [Listener at localhost/34831] snapshot.RestoreSnapshotHelper(239): region to add: 92a7db0f18e3fd67d4c8e3c9b1bf61e5 2023-02-16 18:01:40,470 INFO [Listener at localhost/34831] snapshot.RestoreSnapshotHelper(239): region to add: a5cf4b56498ec7331bb3a0f533d41fc2 2023-02-16 18:01:40,470 INFO [Listener at localhost/34831] snapshot.RestoreSnapshotHelper(585): clone region=86f2541ba97be80de5233420d382624d as 86f2541ba97be80de5233420d382624d in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,470 INFO [Listener at localhost/34831] snapshot.RestoreSnapshotHelper(585): clone region=44bd149ba1e4dc457155e72145b92804 as 44bd149ba1e4dc457155e72145b92804 in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,470 INFO [Listener at localhost/34831] snapshot.RestoreSnapshotHelper(585): clone region=e7445758c3b995e9c904d54090c0098f as e7445758c3b995e9c904d54090c0098f in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,470 INFO [Listener at localhost/34831] snapshot.RestoreSnapshotHelper(585): clone region=3b23ebcb7a063fa26cbc8e7ad4af5a30 as 3b23ebcb7a063fa26cbc8e7ad4af5a30 in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,470 INFO [Listener at localhost/34831] snapshot.RestoreSnapshotHelper(585): clone region=664fd63b9893f58d619f365d46c359ac as 664fd63b9893f58d619f365d46c359ac in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,470 INFO [Listener at localhost/34831] snapshot.RestoreSnapshotHelper(585): clone region=aeef298fd4c8182aec11e6f13fb1f498 as aeef298fd4c8182aec11e6f13fb1f498 in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,470 INFO [Listener at localhost/34831] snapshot.RestoreSnapshotHelper(585): clone region=95c95ff4a3c7bc5bf657c871bd52be7f as 95c95ff4a3c7bc5bf657c871bd52be7f in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,470 INFO [Listener at localhost/34831] snapshot.RestoreSnapshotHelper(585): clone region=777832e7eb6d1f4669aed8cac8c2cce9 as 777832e7eb6d1f4669aed8cac8c2cce9 in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,470 INFO [Listener at localhost/34831] snapshot.RestoreSnapshotHelper(585): clone region=92a7db0f18e3fd67d4c8e3c9b1bf61e5 as 92a7db0f18e3fd67d4c8e3c9b1bf61e5 in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,471 INFO [Listener at localhost/34831] snapshot.RestoreSnapshotHelper(585): clone region=a5cf4b56498ec7331bb3a0f533d41fc2 as a5cf4b56498ec7331bb3a0f533d41fc2 in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,471 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 86f2541ba97be80de5233420d382624d, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2 2023-02-16 18:01:40,471 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 664fd63b9893f58d619f365d46c359ac, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2 2023-02-16 18:01:40,472 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 3b23ebcb7a063fa26cbc8e7ad4af5a30, NAME => 'testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2 2023-02-16 18:01:40,472 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => e7445758c3b995e9c904d54090c0098f, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676570497226.e7445758c3b995e9c904d54090c0098f.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2 2023-02-16 18:01:40,472 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 44bd149ba1e4dc457155e72145b92804, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676570497226.44bd149ba1e4dc457155e72145b92804.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2 2023-02-16 18:01:40,473 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 777832e7eb6d1f4669aed8cac8c2cce9, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2 2023-02-16 18:01:40,473 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 95c95ff4a3c7bc5bf657c871bd52be7f, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2 2023-02-16 18:01:40,473 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => aeef298fd4c8182aec11e6f13fb1f498, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2 2023-02-16 18:01:40,509 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:40,510 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6fbb1eaa05d6417d954d7862b2682f1e from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,516 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:40,516 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 3b23ebcb7a063fa26cbc8e7ad4af5a30, disabling compactions & flushes 2023-02-16 18:01:40,516 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30. 2023-02-16 18:01:40,517 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30. 2023-02-16 18:01:40,517 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30. after waiting 0 ms 2023-02-16 18:01:40,517 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30. 2023-02-16 18:01:40,517 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30. 2023-02-16 18:01:40,517 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 3b23ebcb7a063fa26cbc8e7ad4af5a30: 2023-02-16 18:01:40,517 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 92a7db0f18e3fd67d4c8e3c9b1bf61e5, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2 2023-02-16 18:01:40,526 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:40,526 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f217d5e2b18e4c61872954e6363cc73f from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,527 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b8f6d8a77d4943a0a88ed4633a7af8f8 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,527 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:40,527 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 86f2541ba97be80de5233420d382624d, disabling compactions & flushes 2023-02-16 18:01:40,527 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d. 2023-02-16 18:01:40,527 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d. 2023-02-16 18:01:40,527 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d. after waiting 0 ms 2023-02-16 18:01:40,528 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d. 2023-02-16 18:01:40,528 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d. 2023-02-16 18:01:40,528 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 86f2541ba97be80de5233420d382624d: 2023-02-16 18:01:40,528 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => a5cf4b56498ec7331bb3a0f533d41fc2, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2 2023-02-16 18:01:40,528 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:40,528 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 53fb3d5d19694c9b906cae37ddda4fe9 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,532 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:40,532 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f2bcebb4056a472fa6d9cebcc67855d9 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,532 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676570497226.e7445758c3b995e9c904d54090c0098f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:40,532 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b696f8c059374a7ea689c53bc7e676b5 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,533 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676570497226.44bd149ba1e4dc457155e72145b92804.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:40,533 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8fda2e6ded084e99be0199b3b806769a from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,540 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing aeef298fd4c8182aec11e6f13fb1f498, disabling compactions & flushes 2023-02-16 18:01:40,541 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498. 2023-02-16 18:01:40,541 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498. 2023-02-16 18:01:40,541 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498. after waiting 0 ms 2023-02-16 18:01:40,541 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498. 2023-02-16 18:01:40,541 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498. 2023-02-16 18:01:40,541 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for aeef298fd4c8182aec11e6f13fb1f498: 2023-02-16 18:01:40,544 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:40,544 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4704e763606846cd9f9cf7301d58ace2 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,544 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5b29df03dcf2498ab4012e6e1ad86415 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,544 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e0d1060699f74c0e830c6d64b3bbe17a from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,544 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1a567472d75b41d3a7b2c433da099db1 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,544 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f58c8230c8a14d33907c5a9430d691ae from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,544 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e2d3fc77d5bc4d5fbf5a119e083fd48e from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,549 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 777832e7eb6d1f4669aed8cac8c2cce9, disabling compactions & flushes 2023-02-16 18:01:40,549 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9. 2023-02-16 18:01:40,549 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9. 2023-02-16 18:01:40,550 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9. after waiting 0 ms 2023-02-16 18:01:40,550 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9. 2023-02-16 18:01:40,550 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9. 2023-02-16 18:01:40,550 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 777832e7eb6d1f4669aed8cac8c2cce9: 2023-02-16 18:01:40,550 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:40,550 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 05fdf01c312345838cd45c949a7391cf from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,552 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 664fd63b9893f58d619f365d46c359ac, disabling compactions & flushes 2023-02-16 18:01:40,552 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac. 2023-02-16 18:01:40,552 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac. 2023-02-16 18:01:40,552 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac. after waiting 0 ms 2023-02-16 18:01:40,552 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac. 2023-02-16 18:01:40,552 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac. 2023-02-16 18:01:40,552 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 664fd63b9893f58d619f365d46c359ac: 2023-02-16 18:01:40,555 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing e7445758c3b995e9c904d54090c0098f, disabling compactions & flushes 2023-02-16 18:01:40,555 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 44bd149ba1e4dc457155e72145b92804, disabling compactions & flushes 2023-02-16 18:01:40,555 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676570497226.e7445758c3b995e9c904d54090c0098f. 2023-02-16 18:01:40,555 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676570497226.44bd149ba1e4dc457155e72145b92804. 2023-02-16 18:01:40,555 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676570497226.e7445758c3b995e9c904d54090c0098f. 2023-02-16 18:01:40,555 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676570497226.44bd149ba1e4dc457155e72145b92804. 2023-02-16 18:01:40,555 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676570497226.e7445758c3b995e9c904d54090c0098f. after waiting 0 ms 2023-02-16 18:01:40,556 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676570497226.44bd149ba1e4dc457155e72145b92804. after waiting 0 ms 2023-02-16 18:01:40,556 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676570497226.e7445758c3b995e9c904d54090c0098f. 2023-02-16 18:01:40,556 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676570497226.44bd149ba1e4dc457155e72145b92804. 2023-02-16 18:01:40,556 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 95c95ff4a3c7bc5bf657c871bd52be7f, disabling compactions & flushes 2023-02-16 18:01:40,556 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676570497226.e7445758c3b995e9c904d54090c0098f. 2023-02-16 18:01:40,556 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink aa5b86b42566427db950eeacfba9a9f8 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,556 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f. 2023-02-16 18:01:40,556 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f. 2023-02-16 18:01:40,556 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f. after waiting 0 ms 2023-02-16 18:01:40,556 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f. 2023-02-16 18:01:40,556 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f. 2023-02-16 18:01:40,556 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 95c95ff4a3c7bc5bf657c871bd52be7f: 2023-02-16 18:01:40,556 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676570497226.44bd149ba1e4dc457155e72145b92804. 2023-02-16 18:01:40,556 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for e7445758c3b995e9c904d54090c0098f: 2023-02-16 18:01:40,556 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 52020cbb29a8494f96fe5505251b0bbd from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:40,556 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 44bd149ba1e4dc457155e72145b92804: 2023-02-16 18:01:40,562 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 92a7db0f18e3fd67d4c8e3c9b1bf61e5, disabling compactions & flushes 2023-02-16 18:01:40,562 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5. 2023-02-16 18:01:40,562 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5. 2023-02-16 18:01:40,562 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5. after waiting 0 ms 2023-02-16 18:01:40,562 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing a5cf4b56498ec7331bb3a0f533d41fc2, disabling compactions & flushes 2023-02-16 18:01:40,562 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5. 2023-02-16 18:01:40,562 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2. 2023-02-16 18:01:40,562 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2. 2023-02-16 18:01:40,562 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5. 2023-02-16 18:01:40,562 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2. after waiting 0 ms 2023-02-16 18:01:40,562 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2. 2023-02-16 18:01:40,562 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 92a7db0f18e3fd67d4c8e3c9b1bf61e5: 2023-02-16 18:01:40,562 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2. 2023-02-16 18:01:40,562 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for a5cf4b56498ec7331bb3a0f533d41fc2: 2023-02-16 18:01:40,563 INFO [Listener at localhost/34831] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676570498458 type: FLUSH version: 2 ttl: 0 2023-02-16 18:01:40,563 DEBUG [Listener at localhost/34831] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2 2023-02-16 18:01:40,563 DEBUG [Listener at localhost/34831] util.CommonFSUtils(682): File system contents for path hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2 2023-02-16 18:01:40,563 DEBUG [Listener at localhost/34831] util.CommonFSUtils(699): |-data/ 2023-02-16 18:01:40,564 DEBUG [Listener at localhost/34831] util.CommonFSUtils(699): |----default/ 2023-02-16 18:01:40,564 DEBUG [Listener at localhost/34831] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-16 18:01:40,564 DEBUG [Listener at localhost/34831] util.CommonFSUtils(699): |----------3b23ebcb7a063fa26cbc8e7ad4af5a30/ 2023-02-16 18:01:40,565 DEBUG [Listener at localhost/34831] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 18:01:40,565 DEBUG [Listener at localhost/34831] util.CommonFSUtils(699): |----------44bd149ba1e4dc457155e72145b92804/ 2023-02-16 18:01:40,565 DEBUG [Listener at localhost/34831] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 18:01:40,565 DEBUG [Listener at localhost/34831] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 18:01:40,565 DEBUG [Listener at localhost/34831] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=44bd149ba1e4dc457155e72145b92804-8fda2e6ded084e99be0199b3b806769a 2023-02-16 18:01:40,565 DEBUG [Listener at localhost/34831] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 18:01:40,566 DEBUG [Listener at localhost/34831] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=44bd149ba1e4dc457155e72145b92804-5b29df03dcf2498ab4012e6e1ad86415 2023-02-16 18:01:40,566 DEBUG [Listener at localhost/34831] util.CommonFSUtils(699): |----------664fd63b9893f58d619f365d46c359ac/ 2023-02-16 18:01:40,566 DEBUG [Listener at localhost/34831] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 18:01:40,566 DEBUG [Listener at localhost/34831] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 18:01:40,566 DEBUG [Listener at localhost/34831] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=664fd63b9893f58d619f365d46c359ac-f2bcebb4056a472fa6d9cebcc67855d9 2023-02-16 18:01:40,566 DEBUG [Listener at localhost/34831] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 18:01:40,567 DEBUG [Listener at localhost/34831] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=664fd63b9893f58d619f365d46c359ac-1a567472d75b41d3a7b2c433da099db1 2023-02-16 18:01:40,567 DEBUG [Listener at localhost/34831] util.CommonFSUtils(699): |----------777832e7eb6d1f4669aed8cac8c2cce9/ 2023-02-16 18:01:40,567 DEBUG [Listener at localhost/34831] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 18:01:40,567 DEBUG [Listener at localhost/34831] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 18:01:40,567 DEBUG [Listener at localhost/34831] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=777832e7eb6d1f4669aed8cac8c2cce9-53fb3d5d19694c9b906cae37ddda4fe9 2023-02-16 18:01:40,567 DEBUG [Listener at localhost/34831] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 18:01:40,568 DEBUG [Listener at localhost/34831] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=777832e7eb6d1f4669aed8cac8c2cce9-f58c8230c8a14d33907c5a9430d691ae 2023-02-16 18:01:40,568 DEBUG [Listener at localhost/34831] util.CommonFSUtils(699): |----------86f2541ba97be80de5233420d382624d/ 2023-02-16 18:01:40,568 DEBUG [Listener at localhost/34831] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 18:01:40,568 DEBUG [Listener at localhost/34831] util.CommonFSUtils(699): |----------92a7db0f18e3fd67d4c8e3c9b1bf61e5/ 2023-02-16 18:01:40,568 DEBUG [Listener at localhost/34831] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 18:01:40,568 DEBUG [Listener at localhost/34831] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 18:01:40,569 DEBUG [Listener at localhost/34831] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=92a7db0f18e3fd67d4c8e3c9b1bf61e5-e0d1060699f74c0e830c6d64b3bbe17a 2023-02-16 18:01:40,569 DEBUG [Listener at localhost/34831] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 18:01:40,569 DEBUG [Listener at localhost/34831] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=92a7db0f18e3fd67d4c8e3c9b1bf61e5-aa5b86b42566427db950eeacfba9a9f8 2023-02-16 18:01:40,569 DEBUG [Listener at localhost/34831] util.CommonFSUtils(699): |----------95c95ff4a3c7bc5bf657c871bd52be7f/ 2023-02-16 18:01:40,569 DEBUG [Listener at localhost/34831] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 18:01:40,569 DEBUG [Listener at localhost/34831] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 18:01:40,570 DEBUG [Listener at localhost/34831] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=95c95ff4a3c7bc5bf657c871bd52be7f-f217d5e2b18e4c61872954e6363cc73f 2023-02-16 18:01:40,570 DEBUG [Listener at localhost/34831] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 18:01:40,570 DEBUG [Listener at localhost/34831] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=95c95ff4a3c7bc5bf657c871bd52be7f-e2d3fc77d5bc4d5fbf5a119e083fd48e 2023-02-16 18:01:40,570 DEBUG [Listener at localhost/34831] util.CommonFSUtils(699): |----------a5cf4b56498ec7331bb3a0f533d41fc2/ 2023-02-16 18:01:40,570 DEBUG [Listener at localhost/34831] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 18:01:40,570 DEBUG [Listener at localhost/34831] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 18:01:40,571 DEBUG [Listener at localhost/34831] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=a5cf4b56498ec7331bb3a0f533d41fc2-05fdf01c312345838cd45c949a7391cf 2023-02-16 18:01:40,571 DEBUG [Listener at localhost/34831] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 18:01:40,571 DEBUG [Listener at localhost/34831] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=a5cf4b56498ec7331bb3a0f533d41fc2-52020cbb29a8494f96fe5505251b0bbd 2023-02-16 18:01:40,571 DEBUG [Listener at localhost/34831] util.CommonFSUtils(699): |----------aeef298fd4c8182aec11e6f13fb1f498/ 2023-02-16 18:01:40,571 DEBUG [Listener at localhost/34831] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 18:01:40,571 DEBUG [Listener at localhost/34831] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 18:01:40,572 DEBUG [Listener at localhost/34831] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=aeef298fd4c8182aec11e6f13fb1f498-6fbb1eaa05d6417d954d7862b2682f1e 2023-02-16 18:01:40,572 DEBUG [Listener at localhost/34831] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 18:01:40,572 DEBUG [Listener at localhost/34831] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=aeef298fd4c8182aec11e6f13fb1f498-b8f6d8a77d4943a0a88ed4633a7af8f8 2023-02-16 18:01:40,572 DEBUG [Listener at localhost/34831] util.CommonFSUtils(699): |----------e7445758c3b995e9c904d54090c0098f/ 2023-02-16 18:01:40,572 DEBUG [Listener at localhost/34831] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 18:01:40,572 DEBUG [Listener at localhost/34831] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 18:01:40,573 DEBUG [Listener at localhost/34831] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=e7445758c3b995e9c904d54090c0098f-b696f8c059374a7ea689c53bc7e676b5 2023-02-16 18:01:40,573 DEBUG [Listener at localhost/34831] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 18:01:40,573 DEBUG [Listener at localhost/34831] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=e7445758c3b995e9c904d54090c0098f-4704e763606846cd9f9cf7301d58ace2 2023-02-16 18:01:40,576 INFO [Listener at localhost/34831] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-16 18:01:41,131 DEBUG [Listener at localhost/34831] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:41,131 INFO [Listener at localhost/34831] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 18:01:41,132 DEBUG [Listener at localhost/34831] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:41,134 INFO [StoreOpener-3b23ebcb7a063fa26cbc8e7ad4af5a30-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3b23ebcb7a063fa26cbc8e7ad4af5a30 2023-02-16 18:01:41,136 DEBUG [StoreOpener-3b23ebcb7a063fa26cbc8e7ad4af5a30-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2/data/default/testWithMockedMapReduceMultiRegion/3b23ebcb7a063fa26cbc8e7ad4af5a30/f1 2023-02-16 18:01:41,136 INFO [StoreOpener-3b23ebcb7a063fa26cbc8e7ad4af5a30-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3b23ebcb7a063fa26cbc8e7ad4af5a30 columnFamilyName f1 2023-02-16 18:01:41,136 INFO [StoreOpener-3b23ebcb7a063fa26cbc8e7ad4af5a30-1] regionserver.HStore(310): Store=3b23ebcb7a063fa26cbc8e7ad4af5a30/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:41,137 INFO [StoreOpener-3b23ebcb7a063fa26cbc8e7ad4af5a30-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3b23ebcb7a063fa26cbc8e7ad4af5a30 2023-02-16 18:01:41,138 DEBUG [StoreOpener-3b23ebcb7a063fa26cbc8e7ad4af5a30-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2/data/default/testWithMockedMapReduceMultiRegion/3b23ebcb7a063fa26cbc8e7ad4af5a30/f2 2023-02-16 18:01:41,138 INFO [StoreOpener-3b23ebcb7a063fa26cbc8e7ad4af5a30-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3b23ebcb7a063fa26cbc8e7ad4af5a30 columnFamilyName f2 2023-02-16 18:01:41,138 INFO [StoreOpener-3b23ebcb7a063fa26cbc8e7ad4af5a30-1] regionserver.HStore(310): Store=3b23ebcb7a063fa26cbc8e7ad4af5a30/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:41,138 DEBUG [Listener at localhost/34831] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:41,138 INFO [Listener at localhost/34831] regionserver.HRegion(1071): Opened 3b23ebcb7a063fa26cbc8e7ad4af5a30; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61822361, jitterRate=-0.07877503335475922}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:41,139 DEBUG [Listener at localhost/34831] regionserver.HRegion(964): Region open journal for 3b23ebcb7a063fa26cbc8e7ad4af5a30: 2023-02-16 18:01:41,139 DEBUG [Listener at localhost/34831] regionserver.HRegion(1603): Closing 3b23ebcb7a063fa26cbc8e7ad4af5a30, disabling compactions & flushes 2023-02-16 18:01:41,139 INFO [Listener at localhost/34831] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30. 2023-02-16 18:01:41,139 DEBUG [Listener at localhost/34831] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30. 2023-02-16 18:01:41,139 DEBUG [Listener at localhost/34831] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30. after waiting 0 ms 2023-02-16 18:01:41,139 DEBUG [Listener at localhost/34831] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30. 2023-02-16 18:01:41,139 INFO [Listener at localhost/34831] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30. 2023-02-16 18:01:41,139 DEBUG [Listener at localhost/34831] regionserver.HRegion(1557): Region close journal for 3b23ebcb7a063fa26cbc8e7ad4af5a30: 2023-02-16 18:01:41,140 DEBUG [Listener at localhost/34831] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:41,140 INFO [Listener at localhost/34831] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 18:01:41,141 DEBUG [Listener at localhost/34831] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:41,142 INFO [StoreOpener-777832e7eb6d1f4669aed8cac8c2cce9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 777832e7eb6d1f4669aed8cac8c2cce9 2023-02-16 18:01:41,143 DEBUG [StoreOpener-777832e7eb6d1f4669aed8cac8c2cce9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/f1 2023-02-16 18:01:41,143 INFO [StoreOpener-777832e7eb6d1f4669aed8cac8c2cce9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 777832e7eb6d1f4669aed8cac8c2cce9 columnFamilyName f1 2023-02-16 18:01:41,147 DEBUG [StoreOpener-777832e7eb6d1f4669aed8cac8c2cce9-1] regionserver.HStore(539): loaded hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/f1/testWithMockedMapReduceMultiRegion=777832e7eb6d1f4669aed8cac8c2cce9-53fb3d5d19694c9b906cae37ddda4fe9 2023-02-16 18:01:41,147 INFO [StoreOpener-777832e7eb6d1f4669aed8cac8c2cce9-1] regionserver.HStore(310): Store=777832e7eb6d1f4669aed8cac8c2cce9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:41,148 INFO [StoreOpener-777832e7eb6d1f4669aed8cac8c2cce9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 777832e7eb6d1f4669aed8cac8c2cce9 2023-02-16 18:01:41,148 DEBUG [StoreOpener-777832e7eb6d1f4669aed8cac8c2cce9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/f2 2023-02-16 18:01:41,148 INFO [StoreOpener-777832e7eb6d1f4669aed8cac8c2cce9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 777832e7eb6d1f4669aed8cac8c2cce9 columnFamilyName f2 2023-02-16 18:01:41,152 DEBUG [StoreOpener-777832e7eb6d1f4669aed8cac8c2cce9-1] regionserver.HStore(539): loaded hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/f2/testWithMockedMapReduceMultiRegion=777832e7eb6d1f4669aed8cac8c2cce9-f58c8230c8a14d33907c5a9430d691ae 2023-02-16 18:01:41,152 INFO [StoreOpener-777832e7eb6d1f4669aed8cac8c2cce9-1] regionserver.HStore(310): Store=777832e7eb6d1f4669aed8cac8c2cce9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:41,152 DEBUG [Listener at localhost/34831] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:41,152 INFO [Listener at localhost/34831] regionserver.HRegion(1071): Opened 777832e7eb6d1f4669aed8cac8c2cce9; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62448821, jitterRate=-0.06944005191326141}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:41,152 DEBUG [Listener at localhost/34831] regionserver.HRegion(964): Region open journal for 777832e7eb6d1f4669aed8cac8c2cce9: 2023-02-16 18:01:41,163 DEBUG [Listener at localhost/34831] regionserver.HRegion(1603): Closing 777832e7eb6d1f4669aed8cac8c2cce9, disabling compactions & flushes 2023-02-16 18:01:41,163 INFO [Listener at localhost/34831] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9. 2023-02-16 18:01:41,163 DEBUG [Listener at localhost/34831] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9. 2023-02-16 18:01:41,163 DEBUG [Listener at localhost/34831] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9. after waiting 0 ms 2023-02-16 18:01:41,163 DEBUG [Listener at localhost/34831] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9. 2023-02-16 18:01:41,164 INFO [Listener at localhost/34831] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9. 2023-02-16 18:01:41,164 DEBUG [Listener at localhost/34831] regionserver.HRegion(1557): Region close journal for 777832e7eb6d1f4669aed8cac8c2cce9: 2023-02-16 18:01:41,165 DEBUG [Listener at localhost/34831] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:41,165 INFO [Listener at localhost/34831] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 18:01:41,166 DEBUG [Listener at localhost/34831] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:41,168 INFO [StoreOpener-86f2541ba97be80de5233420d382624d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 86f2541ba97be80de5233420d382624d 2023-02-16 18:01:41,169 DEBUG [StoreOpener-86f2541ba97be80de5233420d382624d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2/data/default/testWithMockedMapReduceMultiRegion/86f2541ba97be80de5233420d382624d/f1 2023-02-16 18:01:41,169 INFO [StoreOpener-86f2541ba97be80de5233420d382624d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 86f2541ba97be80de5233420d382624d columnFamilyName f1 2023-02-16 18:01:41,170 INFO [StoreOpener-86f2541ba97be80de5233420d382624d-1] regionserver.HStore(310): Store=86f2541ba97be80de5233420d382624d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:41,170 INFO [StoreOpener-86f2541ba97be80de5233420d382624d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 86f2541ba97be80de5233420d382624d 2023-02-16 18:01:41,171 DEBUG [StoreOpener-86f2541ba97be80de5233420d382624d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2/data/default/testWithMockedMapReduceMultiRegion/86f2541ba97be80de5233420d382624d/f2 2023-02-16 18:01:41,171 INFO [StoreOpener-86f2541ba97be80de5233420d382624d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 86f2541ba97be80de5233420d382624d columnFamilyName f2 2023-02-16 18:01:41,172 INFO [StoreOpener-86f2541ba97be80de5233420d382624d-1] regionserver.HStore(310): Store=86f2541ba97be80de5233420d382624d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:41,172 DEBUG [Listener at localhost/34831] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:41,172 INFO [Listener at localhost/34831] regionserver.HRegion(1071): Opened 86f2541ba97be80de5233420d382624d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64758163, jitterRate=-0.03502817451953888}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:41,172 DEBUG [Listener at localhost/34831] regionserver.HRegion(964): Region open journal for 86f2541ba97be80de5233420d382624d: 2023-02-16 18:01:41,172 DEBUG [Listener at localhost/34831] regionserver.HRegion(1603): Closing 86f2541ba97be80de5233420d382624d, disabling compactions & flushes 2023-02-16 18:01:41,172 INFO [Listener at localhost/34831] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d. 2023-02-16 18:01:41,172 DEBUG [Listener at localhost/34831] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d. 2023-02-16 18:01:41,172 DEBUG [Listener at localhost/34831] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d. after waiting 0 ms 2023-02-16 18:01:41,172 DEBUG [Listener at localhost/34831] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d. 2023-02-16 18:01:41,173 INFO [Listener at localhost/34831] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d. 2023-02-16 18:01:41,173 DEBUG [Listener at localhost/34831] regionserver.HRegion(1557): Region close journal for 86f2541ba97be80de5233420d382624d: 2023-02-16 18:01:41,173 DEBUG [Listener at localhost/34831] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:41,174 INFO [Listener at localhost/34831] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 18:01:41,175 DEBUG [Listener at localhost/34831] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:41,177 INFO [StoreOpener-92a7db0f18e3fd67d4c8e3c9b1bf61e5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 92a7db0f18e3fd67d4c8e3c9b1bf61e5 2023-02-16 18:01:41,177 DEBUG [StoreOpener-92a7db0f18e3fd67d4c8e3c9b1bf61e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/f1 2023-02-16 18:01:41,178 INFO [StoreOpener-92a7db0f18e3fd67d4c8e3c9b1bf61e5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92a7db0f18e3fd67d4c8e3c9b1bf61e5 columnFamilyName f1 2023-02-16 18:01:41,182 DEBUG [StoreOpener-92a7db0f18e3fd67d4c8e3c9b1bf61e5-1] regionserver.HStore(539): loaded hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/f1/testWithMockedMapReduceMultiRegion=92a7db0f18e3fd67d4c8e3c9b1bf61e5-e0d1060699f74c0e830c6d64b3bbe17a 2023-02-16 18:01:41,182 INFO [StoreOpener-92a7db0f18e3fd67d4c8e3c9b1bf61e5-1] regionserver.HStore(310): Store=92a7db0f18e3fd67d4c8e3c9b1bf61e5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:41,182 INFO [StoreOpener-92a7db0f18e3fd67d4c8e3c9b1bf61e5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 92a7db0f18e3fd67d4c8e3c9b1bf61e5 2023-02-16 18:01:41,183 DEBUG [StoreOpener-92a7db0f18e3fd67d4c8e3c9b1bf61e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/f2 2023-02-16 18:01:41,183 INFO [StoreOpener-92a7db0f18e3fd67d4c8e3c9b1bf61e5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92a7db0f18e3fd67d4c8e3c9b1bf61e5 columnFamilyName f2 2023-02-16 18:01:41,186 DEBUG [StoreOpener-92a7db0f18e3fd67d4c8e3c9b1bf61e5-1] regionserver.HStore(539): loaded hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/f2/testWithMockedMapReduceMultiRegion=92a7db0f18e3fd67d4c8e3c9b1bf61e5-aa5b86b42566427db950eeacfba9a9f8 2023-02-16 18:01:41,187 INFO [StoreOpener-92a7db0f18e3fd67d4c8e3c9b1bf61e5-1] regionserver.HStore(310): Store=92a7db0f18e3fd67d4c8e3c9b1bf61e5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:41,187 DEBUG [Listener at localhost/34831] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:41,187 INFO [Listener at localhost/34831] regionserver.HRegion(1071): Opened 92a7db0f18e3fd67d4c8e3c9b1bf61e5; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71373549, jitterRate=0.06354875862598419}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:41,187 DEBUG [Listener at localhost/34831] regionserver.HRegion(964): Region open journal for 92a7db0f18e3fd67d4c8e3c9b1bf61e5: 2023-02-16 18:01:41,195 DEBUG [Listener at localhost/34831] regionserver.HRegion(1603): Closing 92a7db0f18e3fd67d4c8e3c9b1bf61e5, disabling compactions & flushes 2023-02-16 18:01:41,195 INFO [Listener at localhost/34831] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5. 2023-02-16 18:01:41,195 DEBUG [Listener at localhost/34831] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5. 2023-02-16 18:01:41,195 DEBUG [Listener at localhost/34831] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5. after waiting 0 ms 2023-02-16 18:01:41,195 DEBUG [Listener at localhost/34831] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5. 2023-02-16 18:01:41,196 INFO [Listener at localhost/34831] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5. 2023-02-16 18:01:41,196 DEBUG [Listener at localhost/34831] regionserver.HRegion(1557): Region close journal for 92a7db0f18e3fd67d4c8e3c9b1bf61e5: 2023-02-16 18:01:41,196 DEBUG [Listener at localhost/34831] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:41,196 INFO [Listener at localhost/34831] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 18:01:41,198 DEBUG [Listener at localhost/34831] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:41,199 INFO [StoreOpener-a5cf4b56498ec7331bb3a0f533d41fc2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a5cf4b56498ec7331bb3a0f533d41fc2 2023-02-16 18:01:41,200 DEBUG [StoreOpener-a5cf4b56498ec7331bb3a0f533d41fc2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/f1 2023-02-16 18:01:41,200 INFO [StoreOpener-a5cf4b56498ec7331bb3a0f533d41fc2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a5cf4b56498ec7331bb3a0f533d41fc2 columnFamilyName f1 2023-02-16 18:01:41,204 DEBUG [StoreOpener-a5cf4b56498ec7331bb3a0f533d41fc2-1] regionserver.HStore(539): loaded hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/f1/testWithMockedMapReduceMultiRegion=a5cf4b56498ec7331bb3a0f533d41fc2-05fdf01c312345838cd45c949a7391cf 2023-02-16 18:01:41,204 INFO [StoreOpener-a5cf4b56498ec7331bb3a0f533d41fc2-1] regionserver.HStore(310): Store=a5cf4b56498ec7331bb3a0f533d41fc2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:41,204 INFO [StoreOpener-a5cf4b56498ec7331bb3a0f533d41fc2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a5cf4b56498ec7331bb3a0f533d41fc2 2023-02-16 18:01:41,204 DEBUG [StoreOpener-a5cf4b56498ec7331bb3a0f533d41fc2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/f2 2023-02-16 18:01:41,205 INFO [StoreOpener-a5cf4b56498ec7331bb3a0f533d41fc2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a5cf4b56498ec7331bb3a0f533d41fc2 columnFamilyName f2 2023-02-16 18:01:41,208 DEBUG [StoreOpener-a5cf4b56498ec7331bb3a0f533d41fc2-1] regionserver.HStore(539): loaded hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/f2/testWithMockedMapReduceMultiRegion=a5cf4b56498ec7331bb3a0f533d41fc2-52020cbb29a8494f96fe5505251b0bbd 2023-02-16 18:01:41,208 INFO [StoreOpener-a5cf4b56498ec7331bb3a0f533d41fc2-1] regionserver.HStore(310): Store=a5cf4b56498ec7331bb3a0f533d41fc2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:41,208 DEBUG [Listener at localhost/34831] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:41,209 INFO [Listener at localhost/34831] regionserver.HRegion(1071): Opened a5cf4b56498ec7331bb3a0f533d41fc2; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62928802, jitterRate=-0.06228777766227722}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:41,209 DEBUG [Listener at localhost/34831] regionserver.HRegion(964): Region open journal for a5cf4b56498ec7331bb3a0f533d41fc2: 2023-02-16 18:01:41,217 DEBUG [Listener at localhost/34831] regionserver.HRegion(1603): Closing a5cf4b56498ec7331bb3a0f533d41fc2, disabling compactions & flushes 2023-02-16 18:01:41,219 INFO [Listener at localhost/34831] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2. 2023-02-16 18:01:41,219 DEBUG [Listener at localhost/34831] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2. 2023-02-16 18:01:41,219 DEBUG [Listener at localhost/34831] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2. after waiting 0 ms 2023-02-16 18:01:41,219 DEBUG [Listener at localhost/34831] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2. 2023-02-16 18:01:41,220 INFO [Listener at localhost/34831] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2. 2023-02-16 18:01:41,220 DEBUG [Listener at localhost/34831] regionserver.HRegion(1557): Region close journal for a5cf4b56498ec7331bb3a0f533d41fc2: 2023-02-16 18:01:41,220 DEBUG [Listener at localhost/34831] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:41,220 INFO [Listener at localhost/34831] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 18:01:41,221 DEBUG [Listener at localhost/34831] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:41,223 INFO [StoreOpener-664fd63b9893f58d619f365d46c359ac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 664fd63b9893f58d619f365d46c359ac 2023-02-16 18:01:41,223 DEBUG [StoreOpener-664fd63b9893f58d619f365d46c359ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/f1 2023-02-16 18:01:41,224 INFO [StoreOpener-664fd63b9893f58d619f365d46c359ac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 664fd63b9893f58d619f365d46c359ac columnFamilyName f1 2023-02-16 18:01:41,227 DEBUG [StoreOpener-664fd63b9893f58d619f365d46c359ac-1] regionserver.HStore(539): loaded hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/f1/testWithMockedMapReduceMultiRegion=664fd63b9893f58d619f365d46c359ac-f2bcebb4056a472fa6d9cebcc67855d9 2023-02-16 18:01:41,228 INFO [StoreOpener-664fd63b9893f58d619f365d46c359ac-1] regionserver.HStore(310): Store=664fd63b9893f58d619f365d46c359ac/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:41,228 INFO [StoreOpener-664fd63b9893f58d619f365d46c359ac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 664fd63b9893f58d619f365d46c359ac 2023-02-16 18:01:41,228 DEBUG [StoreOpener-664fd63b9893f58d619f365d46c359ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/f2 2023-02-16 18:01:41,229 INFO [StoreOpener-664fd63b9893f58d619f365d46c359ac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 664fd63b9893f58d619f365d46c359ac columnFamilyName f2 2023-02-16 18:01:41,232 DEBUG [StoreOpener-664fd63b9893f58d619f365d46c359ac-1] regionserver.HStore(539): loaded hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/f2/testWithMockedMapReduceMultiRegion=664fd63b9893f58d619f365d46c359ac-1a567472d75b41d3a7b2c433da099db1 2023-02-16 18:01:41,232 INFO [StoreOpener-664fd63b9893f58d619f365d46c359ac-1] regionserver.HStore(310): Store=664fd63b9893f58d619f365d46c359ac/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:41,232 DEBUG [Listener at localhost/34831] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:41,232 INFO [Listener at localhost/34831] regionserver.HRegion(1071): Opened 664fd63b9893f58d619f365d46c359ac; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59300231, jitterRate=-0.1163576990365982}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:41,232 DEBUG [Listener at localhost/34831] regionserver.HRegion(964): Region open journal for 664fd63b9893f58d619f365d46c359ac: 2023-02-16 18:01:41,241 DEBUG [Listener at localhost/34831] regionserver.HRegion(1603): Closing 664fd63b9893f58d619f365d46c359ac, disabling compactions & flushes 2023-02-16 18:01:41,241 INFO [Listener at localhost/34831] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac. 2023-02-16 18:01:41,241 DEBUG [Listener at localhost/34831] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac. 2023-02-16 18:01:41,241 DEBUG [Listener at localhost/34831] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac. after waiting 0 ms 2023-02-16 18:01:41,241 DEBUG [Listener at localhost/34831] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac. 2023-02-16 18:01:41,242 INFO [Listener at localhost/34831] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac. 2023-02-16 18:01:41,242 DEBUG [Listener at localhost/34831] regionserver.HRegion(1557): Region close journal for 664fd63b9893f58d619f365d46c359ac: 2023-02-16 18:01:41,242 DEBUG [Listener at localhost/34831] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:41,243 INFO [Listener at localhost/34831] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 18:01:41,244 DEBUG [Listener at localhost/34831] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:41,245 INFO [StoreOpener-95c95ff4a3c7bc5bf657c871bd52be7f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 95c95ff4a3c7bc5bf657c871bd52be7f 2023-02-16 18:01:41,246 DEBUG [StoreOpener-95c95ff4a3c7bc5bf657c871bd52be7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/f1 2023-02-16 18:01:41,246 INFO [StoreOpener-95c95ff4a3c7bc5bf657c871bd52be7f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 95c95ff4a3c7bc5bf657c871bd52be7f columnFamilyName f1 2023-02-16 18:01:41,251 DEBUG [StoreOpener-95c95ff4a3c7bc5bf657c871bd52be7f-1] regionserver.HStore(539): loaded hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/f1/testWithMockedMapReduceMultiRegion=95c95ff4a3c7bc5bf657c871bd52be7f-f217d5e2b18e4c61872954e6363cc73f 2023-02-16 18:01:41,251 INFO [StoreOpener-95c95ff4a3c7bc5bf657c871bd52be7f-1] regionserver.HStore(310): Store=95c95ff4a3c7bc5bf657c871bd52be7f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:41,251 INFO [StoreOpener-95c95ff4a3c7bc5bf657c871bd52be7f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 95c95ff4a3c7bc5bf657c871bd52be7f 2023-02-16 18:01:41,252 DEBUG [StoreOpener-95c95ff4a3c7bc5bf657c871bd52be7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/f2 2023-02-16 18:01:41,252 INFO [StoreOpener-95c95ff4a3c7bc5bf657c871bd52be7f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 95c95ff4a3c7bc5bf657c871bd52be7f columnFamilyName f2 2023-02-16 18:01:41,256 DEBUG [StoreOpener-95c95ff4a3c7bc5bf657c871bd52be7f-1] regionserver.HStore(539): loaded hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/f2/testWithMockedMapReduceMultiRegion=95c95ff4a3c7bc5bf657c871bd52be7f-e2d3fc77d5bc4d5fbf5a119e083fd48e 2023-02-16 18:01:41,256 INFO [StoreOpener-95c95ff4a3c7bc5bf657c871bd52be7f-1] regionserver.HStore(310): Store=95c95ff4a3c7bc5bf657c871bd52be7f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:41,257 DEBUG [Listener at localhost/34831] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:41,257 INFO [Listener at localhost/34831] regionserver.HRegion(1071): Opened 95c95ff4a3c7bc5bf657c871bd52be7f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66972463, jitterRate=-0.002032533288002014}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:41,257 DEBUG [Listener at localhost/34831] regionserver.HRegion(964): Region open journal for 95c95ff4a3c7bc5bf657c871bd52be7f: 2023-02-16 18:01:41,272 DEBUG [Listener at localhost/34831] regionserver.HRegion(1603): Closing 95c95ff4a3c7bc5bf657c871bd52be7f, disabling compactions & flushes 2023-02-16 18:01:41,272 INFO [Listener at localhost/34831] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f. 2023-02-16 18:01:41,272 DEBUG [Listener at localhost/34831] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f. 2023-02-16 18:01:41,272 DEBUG [Listener at localhost/34831] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f. after waiting 0 ms 2023-02-16 18:01:41,272 DEBUG [Listener at localhost/34831] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f. 2023-02-16 18:01:41,273 INFO [Listener at localhost/34831] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f. 2023-02-16 18:01:41,273 DEBUG [Listener at localhost/34831] regionserver.HRegion(1557): Region close journal for 95c95ff4a3c7bc5bf657c871bd52be7f: 2023-02-16 18:01:41,274 DEBUG [Listener at localhost/34831] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676570497226.44bd149ba1e4dc457155e72145b92804.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:41,274 INFO [Listener at localhost/34831] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 18:01:41,275 DEBUG [Listener at localhost/34831] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:41,277 INFO [StoreOpener-44bd149ba1e4dc457155e72145b92804-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 44bd149ba1e4dc457155e72145b92804 2023-02-16 18:01:41,278 DEBUG [StoreOpener-44bd149ba1e4dc457155e72145b92804-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/f1 2023-02-16 18:01:41,278 INFO [StoreOpener-44bd149ba1e4dc457155e72145b92804-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 44bd149ba1e4dc457155e72145b92804 columnFamilyName f1 2023-02-16 18:01:41,282 DEBUG [StoreOpener-44bd149ba1e4dc457155e72145b92804-1] regionserver.HStore(539): loaded hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/f1/testWithMockedMapReduceMultiRegion=44bd149ba1e4dc457155e72145b92804-8fda2e6ded084e99be0199b3b806769a 2023-02-16 18:01:41,282 INFO [StoreOpener-44bd149ba1e4dc457155e72145b92804-1] regionserver.HStore(310): Store=44bd149ba1e4dc457155e72145b92804/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:41,282 INFO [StoreOpener-44bd149ba1e4dc457155e72145b92804-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 44bd149ba1e4dc457155e72145b92804 2023-02-16 18:01:41,283 DEBUG [StoreOpener-44bd149ba1e4dc457155e72145b92804-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/f2 2023-02-16 18:01:41,283 INFO [StoreOpener-44bd149ba1e4dc457155e72145b92804-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 44bd149ba1e4dc457155e72145b92804 columnFamilyName f2 2023-02-16 18:01:41,286 DEBUG [StoreOpener-44bd149ba1e4dc457155e72145b92804-1] regionserver.HStore(539): loaded hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/f2/testWithMockedMapReduceMultiRegion=44bd149ba1e4dc457155e72145b92804-5b29df03dcf2498ab4012e6e1ad86415 2023-02-16 18:01:41,286 INFO [StoreOpener-44bd149ba1e4dc457155e72145b92804-1] regionserver.HStore(310): Store=44bd149ba1e4dc457155e72145b92804/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:41,287 DEBUG [Listener at localhost/34831] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:41,287 INFO [Listener at localhost/34831] regionserver.HRegion(1071): Opened 44bd149ba1e4dc457155e72145b92804; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75334259, jitterRate=0.12256793677806854}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:41,287 DEBUG [Listener at localhost/34831] regionserver.HRegion(964): Region open journal for 44bd149ba1e4dc457155e72145b92804: 2023-02-16 18:01:41,295 DEBUG [Listener at localhost/34831] regionserver.HRegion(1603): Closing 44bd149ba1e4dc457155e72145b92804, disabling compactions & flushes 2023-02-16 18:01:41,295 INFO [Listener at localhost/34831] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676570497226.44bd149ba1e4dc457155e72145b92804. 2023-02-16 18:01:41,295 DEBUG [Listener at localhost/34831] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676570497226.44bd149ba1e4dc457155e72145b92804. 2023-02-16 18:01:41,295 DEBUG [Listener at localhost/34831] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676570497226.44bd149ba1e4dc457155e72145b92804. after waiting 0 ms 2023-02-16 18:01:41,295 DEBUG [Listener at localhost/34831] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676570497226.44bd149ba1e4dc457155e72145b92804. 2023-02-16 18:01:41,296 INFO [Listener at localhost/34831] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676570497226.44bd149ba1e4dc457155e72145b92804. 2023-02-16 18:01:41,296 DEBUG [Listener at localhost/34831] regionserver.HRegion(1557): Region close journal for 44bd149ba1e4dc457155e72145b92804: 2023-02-16 18:01:41,297 DEBUG [Listener at localhost/34831] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:41,297 INFO [Listener at localhost/34831] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 18:01:41,298 DEBUG [Listener at localhost/34831] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:41,300 INFO [StoreOpener-aeef298fd4c8182aec11e6f13fb1f498-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region aeef298fd4c8182aec11e6f13fb1f498 2023-02-16 18:01:41,301 DEBUG [StoreOpener-aeef298fd4c8182aec11e6f13fb1f498-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/f1 2023-02-16 18:01:41,301 INFO [StoreOpener-aeef298fd4c8182aec11e6f13fb1f498-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aeef298fd4c8182aec11e6f13fb1f498 columnFamilyName f1 2023-02-16 18:01:41,305 DEBUG [StoreOpener-aeef298fd4c8182aec11e6f13fb1f498-1] regionserver.HStore(539): loaded hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/f1/testWithMockedMapReduceMultiRegion=aeef298fd4c8182aec11e6f13fb1f498-6fbb1eaa05d6417d954d7862b2682f1e 2023-02-16 18:01:41,305 INFO [StoreOpener-aeef298fd4c8182aec11e6f13fb1f498-1] regionserver.HStore(310): Store=aeef298fd4c8182aec11e6f13fb1f498/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:41,305 INFO [StoreOpener-aeef298fd4c8182aec11e6f13fb1f498-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region aeef298fd4c8182aec11e6f13fb1f498 2023-02-16 18:01:41,306 DEBUG [StoreOpener-aeef298fd4c8182aec11e6f13fb1f498-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/f2 2023-02-16 18:01:41,306 INFO [StoreOpener-aeef298fd4c8182aec11e6f13fb1f498-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aeef298fd4c8182aec11e6f13fb1f498 columnFamilyName f2 2023-02-16 18:01:41,310 DEBUG [StoreOpener-aeef298fd4c8182aec11e6f13fb1f498-1] regionserver.HStore(539): loaded hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/f2/testWithMockedMapReduceMultiRegion=aeef298fd4c8182aec11e6f13fb1f498-b8f6d8a77d4943a0a88ed4633a7af8f8 2023-02-16 18:01:41,310 INFO [StoreOpener-aeef298fd4c8182aec11e6f13fb1f498-1] regionserver.HStore(310): Store=aeef298fd4c8182aec11e6f13fb1f498/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:41,310 DEBUG [Listener at localhost/34831] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:41,311 INFO [Listener at localhost/34831] regionserver.HRegion(1071): Opened aeef298fd4c8182aec11e6f13fb1f498; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74221158, jitterRate=0.10598143935203552}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:41,311 DEBUG [Listener at localhost/34831] regionserver.HRegion(964): Region open journal for aeef298fd4c8182aec11e6f13fb1f498: 2023-02-16 18:01:41,319 DEBUG [Listener at localhost/34831] regionserver.HRegion(1603): Closing aeef298fd4c8182aec11e6f13fb1f498, disabling compactions & flushes 2023-02-16 18:01:41,319 INFO [Listener at localhost/34831] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498. 2023-02-16 18:01:41,319 DEBUG [Listener at localhost/34831] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498. 2023-02-16 18:01:41,320 DEBUG [Listener at localhost/34831] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498. after waiting 0 ms 2023-02-16 18:01:41,320 DEBUG [Listener at localhost/34831] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498. 2023-02-16 18:01:41,320 INFO [Listener at localhost/34831] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498. 2023-02-16 18:01:41,320 DEBUG [Listener at localhost/34831] regionserver.HRegion(1557): Region close journal for aeef298fd4c8182aec11e6f13fb1f498: 2023-02-16 18:01:41,321 DEBUG [Listener at localhost/34831] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676570497226.e7445758c3b995e9c904d54090c0098f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:41,321 INFO [Listener at localhost/34831] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 18:01:41,323 DEBUG [Listener at localhost/34831] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:41,325 INFO [StoreOpener-e7445758c3b995e9c904d54090c0098f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e7445758c3b995e9c904d54090c0098f 2023-02-16 18:01:41,326 DEBUG [StoreOpener-e7445758c3b995e9c904d54090c0098f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/f1 2023-02-16 18:01:41,327 INFO [StoreOpener-e7445758c3b995e9c904d54090c0098f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e7445758c3b995e9c904d54090c0098f columnFamilyName f1 2023-02-16 18:01:41,331 DEBUG [StoreOpener-e7445758c3b995e9c904d54090c0098f-1] regionserver.HStore(539): loaded hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/f1/testWithMockedMapReduceMultiRegion=e7445758c3b995e9c904d54090c0098f-b696f8c059374a7ea689c53bc7e676b5 2023-02-16 18:01:41,332 INFO [StoreOpener-e7445758c3b995e9c904d54090c0098f-1] regionserver.HStore(310): Store=e7445758c3b995e9c904d54090c0098f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:41,332 INFO [StoreOpener-e7445758c3b995e9c904d54090c0098f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e7445758c3b995e9c904d54090c0098f 2023-02-16 18:01:41,332 DEBUG [StoreOpener-e7445758c3b995e9c904d54090c0098f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/f2 2023-02-16 18:01:41,333 INFO [StoreOpener-e7445758c3b995e9c904d54090c0098f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e7445758c3b995e9c904d54090c0098f columnFamilyName f2 2023-02-16 18:01:41,336 DEBUG [StoreOpener-e7445758c3b995e9c904d54090c0098f-1] regionserver.HStore(539): loaded hdfs://localhost:40013/user/jenkins/test-data/9be7b405-d337-c5b2-677e-c09b8556ad17/testWithMockedMapReduceMultiRegion/9c0679d7-adbc-4e93-a710-5f6005cf26f2/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/f2/testWithMockedMapReduceMultiRegion=e7445758c3b995e9c904d54090c0098f-4704e763606846cd9f9cf7301d58ace2 2023-02-16 18:01:41,336 INFO [StoreOpener-e7445758c3b995e9c904d54090c0098f-1] regionserver.HStore(310): Store=e7445758c3b995e9c904d54090c0098f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:41,337 DEBUG [Listener at localhost/34831] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:41,337 INFO [Listener at localhost/34831] regionserver.HRegion(1071): Opened e7445758c3b995e9c904d54090c0098f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62230668, jitterRate=-0.07269078493118286}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:41,337 DEBUG [Listener at localhost/34831] regionserver.HRegion(964): Region open journal for e7445758c3b995e9c904d54090c0098f: 2023-02-16 18:01:41,345 DEBUG [Listener at localhost/34831] regionserver.HRegion(1603): Closing e7445758c3b995e9c904d54090c0098f, disabling compactions & flushes 2023-02-16 18:01:41,345 INFO [Listener at localhost/34831] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676570497226.e7445758c3b995e9c904d54090c0098f. 2023-02-16 18:01:41,345 DEBUG [Listener at localhost/34831] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676570497226.e7445758c3b995e9c904d54090c0098f. 2023-02-16 18:01:41,345 DEBUG [Listener at localhost/34831] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676570497226.e7445758c3b995e9c904d54090c0098f. after waiting 0 ms 2023-02-16 18:01:41,345 DEBUG [Listener at localhost/34831] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676570497226.e7445758c3b995e9c904d54090c0098f. 2023-02-16 18:01:41,346 INFO [Listener at localhost/34831] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676570497226.e7445758c3b995e9c904d54090c0098f. 2023-02-16 18:01:41,346 DEBUG [Listener at localhost/34831] regionserver.HRegion(1557): Region close journal for e7445758c3b995e9c904d54090c0098f: 2023-02-16 18:01:41,352 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-16 18:01:41,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-16 18:01:41,356 INFO [Listener at localhost/34831] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-16 18:01:41,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-16 18:01:41,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:41,361 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676570501361"}]},"ts":"1676570501361"} 2023-02-16 18:01:41,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-16 18:01:41,362 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-16 18:01:41,422 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-16 18:01:41,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-16 18:01:41,477 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3b23ebcb7a063fa26cbc8e7ad4af5a30, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=95c95ff4a3c7bc5bf657c871bd52be7f, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e7445758c3b995e9c904d54090c0098f, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=aeef298fd4c8182aec11e6f13fb1f498, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=664fd63b9893f58d619f365d46c359ac, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=44bd149ba1e4dc457155e72145b92804, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a5cf4b56498ec7331bb3a0f533d41fc2, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=92a7db0f18e3fd67d4c8e3c9b1bf61e5, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=777832e7eb6d1f4669aed8cac8c2cce9, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=86f2541ba97be80de5233420d382624d, UNASSIGN}] 2023-02-16 18:01:41,479 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3b23ebcb7a063fa26cbc8e7ad4af5a30, UNASSIGN 2023-02-16 18:01:41,479 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e7445758c3b995e9c904d54090c0098f, UNASSIGN 2023-02-16 18:01:41,479 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=aeef298fd4c8182aec11e6f13fb1f498, UNASSIGN 2023-02-16 18:01:41,479 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=95c95ff4a3c7bc5bf657c871bd52be7f, UNASSIGN 2023-02-16 18:01:41,479 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=86f2541ba97be80de5233420d382624d, UNASSIGN 2023-02-16 18:01:41,480 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=3b23ebcb7a063fa26cbc8e7ad4af5a30, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:41,480 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=aeef298fd4c8182aec11e6f13fb1f498, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:41,480 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676570501479"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570501479"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570501479"}]},"ts":"1676570501479"} 2023-02-16 18:01:41,480 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=e7445758c3b995e9c904d54090c0098f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:41,480 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676570501480"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570501480"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570501480"}]},"ts":"1676570501480"} 2023-02-16 18:01:41,480 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676570497226.e7445758c3b995e9c904d54090c0098f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676570501480"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570501480"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570501480"}]},"ts":"1676570501480"} 2023-02-16 18:01:41,480 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=95c95ff4a3c7bc5bf657c871bd52be7f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:41,480 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=86f2541ba97be80de5233420d382624d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:41,480 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676570501480"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570501480"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570501480"}]},"ts":"1676570501480"} 2023-02-16 18:01:41,480 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676570501480"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570501480"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570501480"}]},"ts":"1676570501480"} 2023-02-16 18:01:41,481 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=34, state=RUNNABLE; CloseRegionProcedure 3b23ebcb7a063fa26cbc8e7ad4af5a30, server=jenkins-hbase4.apache.org,36643,1676570495876}] 2023-02-16 18:01:41,482 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=37, state=RUNNABLE; CloseRegionProcedure aeef298fd4c8182aec11e6f13fb1f498, server=jenkins-hbase4.apache.org,36643,1676570495876}] 2023-02-16 18:01:41,482 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=36, state=RUNNABLE; CloseRegionProcedure e7445758c3b995e9c904d54090c0098f, server=jenkins-hbase4.apache.org,35421,1676570495840}] 2023-02-16 18:01:41,483 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=35, state=RUNNABLE; CloseRegionProcedure 95c95ff4a3c7bc5bf657c871bd52be7f, server=jenkins-hbase4.apache.org,35421,1676570495840}] 2023-02-16 18:01:41,484 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=43, state=RUNNABLE; CloseRegionProcedure 86f2541ba97be80de5233420d382624d, server=jenkins-hbase4.apache.org,35421,1676570495840}] 2023-02-16 18:01:41,485 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=777832e7eb6d1f4669aed8cac8c2cce9, UNASSIGN 2023-02-16 18:01:41,485 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=92a7db0f18e3fd67d4c8e3c9b1bf61e5, UNASSIGN 2023-02-16 18:01:41,485 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=777832e7eb6d1f4669aed8cac8c2cce9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:41,485 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a5cf4b56498ec7331bb3a0f533d41fc2, UNASSIGN 2023-02-16 18:01:41,486 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676570501485"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570501485"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570501485"}]},"ts":"1676570501485"} 2023-02-16 18:01:41,486 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=92a7db0f18e3fd67d4c8e3c9b1bf61e5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:41,486 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=a5cf4b56498ec7331bb3a0f533d41fc2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:41,487 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676570501486"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570501486"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570501486"}]},"ts":"1676570501486"} 2023-02-16 18:01:41,487 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676570501486"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570501486"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570501486"}]},"ts":"1676570501486"} 2023-02-16 18:01:41,487 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=44bd149ba1e4dc457155e72145b92804, UNASSIGN 2023-02-16 18:01:41,487 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure 777832e7eb6d1f4669aed8cac8c2cce9, server=jenkins-hbase4.apache.org,36643,1676570495876}] 2023-02-16 18:01:41,488 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=664fd63b9893f58d619f365d46c359ac, UNASSIGN 2023-02-16 18:01:41,488 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=44bd149ba1e4dc457155e72145b92804, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:41,488 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676570497226.44bd149ba1e4dc457155e72145b92804.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676570501488"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570501488"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570501488"}]},"ts":"1676570501488"} 2023-02-16 18:01:41,488 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=41, state=RUNNABLE; CloseRegionProcedure 92a7db0f18e3fd67d4c8e3c9b1bf61e5, server=jenkins-hbase4.apache.org,35421,1676570495840}] 2023-02-16 18:01:41,488 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=664fd63b9893f58d619f365d46c359ac, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:41,488 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676570501488"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570501488"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570501488"}]},"ts":"1676570501488"} 2023-02-16 18:01:41,489 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=40, state=RUNNABLE; CloseRegionProcedure a5cf4b56498ec7331bb3a0f533d41fc2, server=jenkins-hbase4.apache.org,36643,1676570495876}] 2023-02-16 18:01:41,492 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=39, state=RUNNABLE; CloseRegionProcedure 44bd149ba1e4dc457155e72145b92804, server=jenkins-hbase4.apache.org,36643,1676570495876}] 2023-02-16 18:01:41,493 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=38, state=RUNNABLE; CloseRegionProcedure 664fd63b9893f58d619f365d46c359ac, server=jenkins-hbase4.apache.org,35421,1676570495840}] 2023-02-16 18:01:41,634 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 777832e7eb6d1f4669aed8cac8c2cce9 2023-02-16 18:01:41,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 777832e7eb6d1f4669aed8cac8c2cce9, disabling compactions & flushes 2023-02-16 18:01:41,634 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9. 2023-02-16 18:01:41,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9. 2023-02-16 18:01:41,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9. after waiting 0 ms 2023-02-16 18:01:41,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9. 2023-02-16 18:01:41,635 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e7445758c3b995e9c904d54090c0098f 2023-02-16 18:01:41,635 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e7445758c3b995e9c904d54090c0098f, disabling compactions & flushes 2023-02-16 18:01:41,635 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676570497226.e7445758c3b995e9c904d54090c0098f. 2023-02-16 18:01:41,635 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676570497226.e7445758c3b995e9c904d54090c0098f. 2023-02-16 18:01:41,635 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676570497226.e7445758c3b995e9c904d54090c0098f. after waiting 0 ms 2023-02-16 18:01:41,635 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676570497226.e7445758c3b995e9c904d54090c0098f. 2023-02-16 18:01:41,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 18:01:41,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 18:01:41,639 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9. 2023-02-16 18:01:41,639 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 777832e7eb6d1f4669aed8cac8c2cce9: 2023-02-16 18:01:41,639 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676570497226.e7445758c3b995e9c904d54090c0098f. 2023-02-16 18:01:41,639 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e7445758c3b995e9c904d54090c0098f: 2023-02-16 18:01:41,640 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 777832e7eb6d1f4669aed8cac8c2cce9 2023-02-16 18:01:41,640 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 44bd149ba1e4dc457155e72145b92804 2023-02-16 18:01:41,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 44bd149ba1e4dc457155e72145b92804, disabling compactions & flushes 2023-02-16 18:01:41,640 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676570497226.44bd149ba1e4dc457155e72145b92804. 2023-02-16 18:01:41,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676570497226.44bd149ba1e4dc457155e72145b92804. 2023-02-16 18:01:41,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676570497226.44bd149ba1e4dc457155e72145b92804. after waiting 0 ms 2023-02-16 18:01:41,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676570497226.44bd149ba1e4dc457155e72145b92804. 2023-02-16 18:01:41,640 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=777832e7eb6d1f4669aed8cac8c2cce9, regionState=CLOSED 2023-02-16 18:01:41,641 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676570501640"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570501640"}]},"ts":"1676570501640"} 2023-02-16 18:01:41,641 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e7445758c3b995e9c904d54090c0098f 2023-02-16 18:01:41,641 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 95c95ff4a3c7bc5bf657c871bd52be7f 2023-02-16 18:01:41,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 95c95ff4a3c7bc5bf657c871bd52be7f, disabling compactions & flushes 2023-02-16 18:01:41,641 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f. 2023-02-16 18:01:41,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f. 2023-02-16 18:01:41,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f. after waiting 0 ms 2023-02-16 18:01:41,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f. 2023-02-16 18:01:41,641 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=e7445758c3b995e9c904d54090c0098f, regionState=CLOSED 2023-02-16 18:01:41,641 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676570497226.e7445758c3b995e9c904d54090c0098f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676570501641"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570501641"}]},"ts":"1676570501641"} 2023-02-16 18:01:41,643 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-16 18:01:41,643 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure 777832e7eb6d1f4669aed8cac8c2cce9, server=jenkins-hbase4.apache.org,36643,1676570495876 in 155 msec 2023-02-16 18:01:41,644 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=36 2023-02-16 18:01:41,644 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=36, state=SUCCESS; CloseRegionProcedure e7445758c3b995e9c904d54090c0098f, server=jenkins-hbase4.apache.org,35421,1676570495840 in 161 msec 2023-02-16 18:01:41,645 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=777832e7eb6d1f4669aed8cac8c2cce9, UNASSIGN in 167 msec 2023-02-16 18:01:41,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 18:01:41,645 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e7445758c3b995e9c904d54090c0098f, UNASSIGN in 168 msec 2023-02-16 18:01:41,646 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676570497226.44bd149ba1e4dc457155e72145b92804. 2023-02-16 18:01:41,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 44bd149ba1e4dc457155e72145b92804: 2023-02-16 18:01:41,647 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 44bd149ba1e4dc457155e72145b92804 2023-02-16 18:01:41,647 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close a5cf4b56498ec7331bb3a0f533d41fc2 2023-02-16 18:01:41,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a5cf4b56498ec7331bb3a0f533d41fc2, disabling compactions & flushes 2023-02-16 18:01:41,647 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2. 2023-02-16 18:01:41,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2. 2023-02-16 18:01:41,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2. after waiting 0 ms 2023-02-16 18:01:41,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2. 2023-02-16 18:01:41,647 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=44bd149ba1e4dc457155e72145b92804, regionState=CLOSED 2023-02-16 18:01:41,647 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676570497226.44bd149ba1e4dc457155e72145b92804.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676570501647"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570501647"}]},"ts":"1676570501647"} 2023-02-16 18:01:41,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 18:01:41,650 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=39 2023-02-16 18:01:41,650 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=39, state=SUCCESS; CloseRegionProcedure 44bd149ba1e4dc457155e72145b92804, server=jenkins-hbase4.apache.org,36643,1676570495876 in 159 msec 2023-02-16 18:01:41,650 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f. 2023-02-16 18:01:41,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 95c95ff4a3c7bc5bf657c871bd52be7f: 2023-02-16 18:01:41,651 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=44bd149ba1e4dc457155e72145b92804, UNASSIGN in 174 msec 2023-02-16 18:01:41,651 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 18:01:41,651 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 95c95ff4a3c7bc5bf657c871bd52be7f 2023-02-16 18:01:41,651 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 86f2541ba97be80de5233420d382624d 2023-02-16 18:01:41,651 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 86f2541ba97be80de5233420d382624d, disabling compactions & flushes 2023-02-16 18:01:41,651 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d. 2023-02-16 18:01:41,651 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d. 2023-02-16 18:01:41,651 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d. after waiting 0 ms 2023-02-16 18:01:41,651 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d. 2023-02-16 18:01:41,651 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=95c95ff4a3c7bc5bf657c871bd52be7f, regionState=CLOSED 2023-02-16 18:01:41,651 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676570501651"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570501651"}]},"ts":"1676570501651"} 2023-02-16 18:01:41,651 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2. 2023-02-16 18:01:41,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a5cf4b56498ec7331bb3a0f533d41fc2: 2023-02-16 18:01:41,653 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed a5cf4b56498ec7331bb3a0f533d41fc2 2023-02-16 18:01:41,653 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close aeef298fd4c8182aec11e6f13fb1f498 2023-02-16 18:01:41,653 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing aeef298fd4c8182aec11e6f13fb1f498, disabling compactions & flushes 2023-02-16 18:01:41,653 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498. 2023-02-16 18:01:41,653 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498. 2023-02-16 18:01:41,653 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498. after waiting 0 ms 2023-02-16 18:01:41,653 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498. 2023-02-16 18:01:41,653 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=a5cf4b56498ec7331bb3a0f533d41fc2, regionState=CLOSED 2023-02-16 18:01:41,653 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676570501653"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570501653"}]},"ts":"1676570501653"} 2023-02-16 18:01:41,654 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=35 2023-02-16 18:01:41,654 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/86f2541ba97be80de5233420d382624d/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-16 18:01:41,654 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=35, state=SUCCESS; CloseRegionProcedure 95c95ff4a3c7bc5bf657c871bd52be7f, server=jenkins-hbase4.apache.org,35421,1676570495840 in 169 msec 2023-02-16 18:01:41,655 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d. 2023-02-16 18:01:41,655 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 86f2541ba97be80de5233420d382624d: 2023-02-16 18:01:41,655 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=95c95ff4a3c7bc5bf657c871bd52be7f, UNASSIGN in 178 msec 2023-02-16 18:01:41,657 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=40 2023-02-16 18:01:41,657 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=40, state=SUCCESS; CloseRegionProcedure a5cf4b56498ec7331bb3a0f533d41fc2, server=jenkins-hbase4.apache.org,36643,1676570495876 in 166 msec 2023-02-16 18:01:41,657 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 86f2541ba97be80de5233420d382624d 2023-02-16 18:01:41,657 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 92a7db0f18e3fd67d4c8e3c9b1bf61e5 2023-02-16 18:01:41,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 92a7db0f18e3fd67d4c8e3c9b1bf61e5, disabling compactions & flushes 2023-02-16 18:01:41,657 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5. 2023-02-16 18:01:41,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5. 2023-02-16 18:01:41,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5. after waiting 0 ms 2023-02-16 18:01:41,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5. 2023-02-16 18:01:41,657 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=86f2541ba97be80de5233420d382624d, regionState=CLOSED 2023-02-16 18:01:41,657 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676570501657"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570501657"}]},"ts":"1676570501657"} 2023-02-16 18:01:41,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 18:01:41,658 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a5cf4b56498ec7331bb3a0f533d41fc2, UNASSIGN in 181 msec 2023-02-16 18:01:41,658 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498. 2023-02-16 18:01:41,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for aeef298fd4c8182aec11e6f13fb1f498: 2023-02-16 18:01:41,660 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed aeef298fd4c8182aec11e6f13fb1f498 2023-02-16 18:01:41,660 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=aeef298fd4c8182aec11e6f13fb1f498, regionState=CLOSED 2023-02-16 18:01:41,660 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676570501660"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570501660"}]},"ts":"1676570501660"} 2023-02-16 18:01:41,660 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 3b23ebcb7a063fa26cbc8e7ad4af5a30 2023-02-16 18:01:41,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3b23ebcb7a063fa26cbc8e7ad4af5a30, disabling compactions & flushes 2023-02-16 18:01:41,661 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30. 2023-02-16 18:01:41,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30. 2023-02-16 18:01:41,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30. after waiting 0 ms 2023-02-16 18:01:41,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30. 2023-02-16 18:01:41,662 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=43 2023-02-16 18:01:41,662 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=43, state=SUCCESS; CloseRegionProcedure 86f2541ba97be80de5233420d382624d, server=jenkins-hbase4.apache.org,35421,1676570495840 in 175 msec 2023-02-16 18:01:41,663 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=86f2541ba97be80de5233420d382624d, UNASSIGN in 186 msec 2023-02-16 18:01:41,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-16 18:01:41,664 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=37 2023-02-16 18:01:41,664 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=37, state=SUCCESS; CloseRegionProcedure aeef298fd4c8182aec11e6f13fb1f498, server=jenkins-hbase4.apache.org,36643,1676570495876 in 180 msec 2023-02-16 18:01:41,665 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=aeef298fd4c8182aec11e6f13fb1f498, UNASSIGN in 188 msec 2023-02-16 18:01:41,667 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 18:01:41,667 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/3b23ebcb7a063fa26cbc8e7ad4af5a30/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-16 18:01:41,668 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30. 2023-02-16 18:01:41,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3b23ebcb7a063fa26cbc8e7ad4af5a30: 2023-02-16 18:01:41,669 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 3b23ebcb7a063fa26cbc8e7ad4af5a30 2023-02-16 18:01:41,669 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=3b23ebcb7a063fa26cbc8e7ad4af5a30, regionState=CLOSED 2023-02-16 18:01:41,669 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676570501669"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570501669"}]},"ts":"1676570501669"} 2023-02-16 18:01:41,669 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5. 2023-02-16 18:01:41,669 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 92a7db0f18e3fd67d4c8e3c9b1bf61e5: 2023-02-16 18:01:41,671 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 92a7db0f18e3fd67d4c8e3c9b1bf61e5 2023-02-16 18:01:41,671 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 664fd63b9893f58d619f365d46c359ac 2023-02-16 18:01:41,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 664fd63b9893f58d619f365d46c359ac, disabling compactions & flushes 2023-02-16 18:01:41,671 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac. 2023-02-16 18:01:41,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac. 2023-02-16 18:01:41,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac. after waiting 0 ms 2023-02-16 18:01:41,671 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=92a7db0f18e3fd67d4c8e3c9b1bf61e5, regionState=CLOSED 2023-02-16 18:01:41,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac. 2023-02-16 18:01:41,671 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676570501671"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570501671"}]},"ts":"1676570501671"} 2023-02-16 18:01:41,672 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=34 2023-02-16 18:01:41,672 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=34, state=SUCCESS; CloseRegionProcedure 3b23ebcb7a063fa26cbc8e7ad4af5a30, server=jenkins-hbase4.apache.org,36643,1676570495876 in 190 msec 2023-02-16 18:01:41,673 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3b23ebcb7a063fa26cbc8e7ad4af5a30, UNASSIGN in 196 msec 2023-02-16 18:01:41,674 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=41 2023-02-16 18:01:41,674 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=41, state=SUCCESS; CloseRegionProcedure 92a7db0f18e3fd67d4c8e3c9b1bf61e5, server=jenkins-hbase4.apache.org,35421,1676570495840 in 185 msec 2023-02-16 18:01:41,676 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=92a7db0f18e3fd67d4c8e3c9b1bf61e5, UNASSIGN in 198 msec 2023-02-16 18:01:41,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 18:01:41,680 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac. 2023-02-16 18:01:41,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 664fd63b9893f58d619f365d46c359ac: 2023-02-16 18:01:41,681 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 664fd63b9893f58d619f365d46c359ac 2023-02-16 18:01:41,683 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=664fd63b9893f58d619f365d46c359ac, regionState=CLOSED 2023-02-16 18:01:41,683 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676570501683"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570501683"}]},"ts":"1676570501683"} 2023-02-16 18:01:41,686 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=38 2023-02-16 18:01:41,686 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=38, state=SUCCESS; CloseRegionProcedure 664fd63b9893f58d619f365d46c359ac, server=jenkins-hbase4.apache.org,35421,1676570495840 in 191 msec 2023-02-16 18:01:41,687 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=33 2023-02-16 18:01:41,687 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=664fd63b9893f58d619f365d46c359ac, UNASSIGN in 210 msec 2023-02-16 18:01:41,687 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676570501687"}]},"ts":"1676570501687"} 2023-02-16 18:01:41,688 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-16 18:01:41,768 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-16 18:01:41,770 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 412 msec 2023-02-16 18:01:41,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-16 18:01:41,965 INFO [Listener at localhost/34831] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-16 18:01:41,966 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceMultiRegion 2023-02-16 18:01:41,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:41,968 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:41,969 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:41,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-16 18:01:41,980 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/3b23ebcb7a063fa26cbc8e7ad4af5a30 2023-02-16 18:01:41,980 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f 2023-02-16 18:01:41,980 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804 2023-02-16 18:01:41,980 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac 2023-02-16 18:01:41,980 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2 2023-02-16 18:01:41,980 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5 2023-02-16 18:01:41,980 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f 2023-02-16 18:01:41,980 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498 2023-02-16 18:01:41,985 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/3b23ebcb7a063fa26cbc8e7ad4af5a30/f1, FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/3b23ebcb7a063fa26cbc8e7ad4af5a30/f2, FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/3b23ebcb7a063fa26cbc8e7ad4af5a30/recovered.edits] 2023-02-16 18:01:41,986 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/f1, FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/f2, FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/recovered.edits] 2023-02-16 18:01:41,986 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/f1, FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/f2, FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/recovered.edits] 2023-02-16 18:01:41,987 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/f1, FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/f2, FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/recovered.edits] 2023-02-16 18:01:41,987 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/f1, FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/f2, FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/recovered.edits] 2023-02-16 18:01:41,987 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/f1, FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/f2, FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/recovered.edits] 2023-02-16 18:01:41,988 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/f1, FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/f2, FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/recovered.edits] 2023-02-16 18:01:41,989 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/f1, FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/f2, FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/recovered.edits] 2023-02-16 18:01:41,994 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/f1/658140234cc74af383ff6d85b2b68bca to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/f1/658140234cc74af383ff6d85b2b68bca 2023-02-16 18:01:41,994 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/f1/0286ece5f4f040c7b4f30eec8332a4e8 to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/f1/0286ece5f4f040c7b4f30eec8332a4e8 2023-02-16 18:01:41,995 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/f1/05fdf01c312345838cd45c949a7391cf to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/f1/05fdf01c312345838cd45c949a7391cf 2023-02-16 18:01:41,996 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/f1/8fda2e6ded084e99be0199b3b806769a to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/f1/8fda2e6ded084e99be0199b3b806769a 2023-02-16 18:01:41,996 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/f1/4f64228c50a54343a27264f8ee35bd7f to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/f1/4f64228c50a54343a27264f8ee35bd7f 2023-02-16 18:01:41,996 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/f1/1ff253032bd944e1966f8febdf302511 to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/f1/1ff253032bd944e1966f8febdf302511 2023-02-16 18:01:41,997 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/3b23ebcb7a063fa26cbc8e7ad4af5a30/recovered.edits/6.seqid to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/3b23ebcb7a063fa26cbc8e7ad4af5a30/recovered.edits/6.seqid 2023-02-16 18:01:41,997 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/f1/e0d1060699f74c0e830c6d64b3bbe17a to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/f1/e0d1060699f74c0e830c6d64b3bbe17a 2023-02-16 18:01:41,998 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/f1/3c79116e915840ff85bec378872d9972 to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/f1/3c79116e915840ff85bec378872d9972 2023-02-16 18:01:41,998 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/f1/f2bcebb4056a472fa6d9cebcc67855d9 to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/f1/f2bcebb4056a472fa6d9cebcc67855d9 2023-02-16 18:01:41,998 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/3b23ebcb7a063fa26cbc8e7ad4af5a30 2023-02-16 18:01:41,998 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9 2023-02-16 18:01:41,999 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/f1/38b4ca0894934480b1ac1e7cbb3061ad to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/f1/38b4ca0894934480b1ac1e7cbb3061ad 2023-02-16 18:01:42,000 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/f1/6fbb1eaa05d6417d954d7862b2682f1e to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/f1/6fbb1eaa05d6417d954d7862b2682f1e 2023-02-16 18:01:42,000 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/f1/b696f8c059374a7ea689c53bc7e676b5 to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/f1/b696f8c059374a7ea689c53bc7e676b5 2023-02-16 18:01:42,000 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/f1/f217d5e2b18e4c61872954e6363cc73f to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/f1/f217d5e2b18e4c61872954e6363cc73f 2023-02-16 18:01:42,001 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/f1/a05d1f2cacdf418b957fabbda5daa5ff to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/f1/a05d1f2cacdf418b957fabbda5daa5ff 2023-02-16 18:01:42,004 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/f1, FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/f2, FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/recovered.edits] 2023-02-16 18:01:42,005 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/f2/a9521de6cf3940ac8794a305feb585b0 to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/f2/a9521de6cf3940ac8794a305feb585b0 2023-02-16 18:01:42,006 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/f2/1a567472d75b41d3a7b2c433da099db1 to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/f2/1a567472d75b41d3a7b2c433da099db1 2023-02-16 18:01:42,007 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/f2/0fd0116cbcda4d74b5e495bd7d23e0b1 to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/f2/0fd0116cbcda4d74b5e495bd7d23e0b1 2023-02-16 18:01:42,007 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/f2/aa5b86b42566427db950eeacfba9a9f8 to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/f2/aa5b86b42566427db950eeacfba9a9f8 2023-02-16 18:01:42,007 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/f2/5b29df03dcf2498ab4012e6e1ad86415 to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/f2/5b29df03dcf2498ab4012e6e1ad86415 2023-02-16 18:01:42,007 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/f2/52020cbb29a8494f96fe5505251b0bbd to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/f2/52020cbb29a8494f96fe5505251b0bbd 2023-02-16 18:01:42,007 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/f2/4704e763606846cd9f9cf7301d58ace2 to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/f2/4704e763606846cd9f9cf7301d58ace2 2023-02-16 18:01:42,008 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/f2/7e3aea2b9ddf4671bdef89555eb8248f to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/f2/7e3aea2b9ddf4671bdef89555eb8248f 2023-02-16 18:01:42,009 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/f2/77eaf2a6636a4984bbeb348cbb29d1a5 to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/f2/77eaf2a6636a4984bbeb348cbb29d1a5 2023-02-16 18:01:42,009 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/f2/b6c46c22b63d4c8eb0633234bc0ea217 to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/f2/b6c46c22b63d4c8eb0633234bc0ea217 2023-02-16 18:01:42,010 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/f2/e2d3fc77d5bc4d5fbf5a119e083fd48e to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/f2/e2d3fc77d5bc4d5fbf5a119e083fd48e 2023-02-16 18:01:42,011 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/f2/b8f6d8a77d4943a0a88ed4633a7af8f8 to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/f2/b8f6d8a77d4943a0a88ed4633a7af8f8 2023-02-16 18:01:42,011 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/f2/843e0be78fa143929237dcd1bcb45fe7 to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/f2/843e0be78fa143929237dcd1bcb45fe7 2023-02-16 18:01:42,011 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/f2/8b985a15392f43778cd202266696e6b4 to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/f2/8b985a15392f43778cd202266696e6b4 2023-02-16 18:01:42,012 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/f1/2d8d3045a8484a54be93d60414bb48cb to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/f1/2d8d3045a8484a54be93d60414bb48cb 2023-02-16 18:01:42,018 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-16 18:01:42,019 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/recovered.edits/12.seqid to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5/recovered.edits/12.seqid 2023-02-16 18:01:42,019 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/recovered.edits/12.seqid to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac/recovered.edits/12.seqid 2023-02-16 18:01:42,020 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/f1/53fb3d5d19694c9b906cae37ddda4fe9 to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/f1/53fb3d5d19694c9b906cae37ddda4fe9 2023-02-16 18:01:42,020 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/92a7db0f18e3fd67d4c8e3c9b1bf61e5 2023-02-16 18:01:42,020 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/86f2541ba97be80de5233420d382624d 2023-02-16 18:01:42,021 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/664fd63b9893f58d619f365d46c359ac 2023-02-16 18:01:42,028 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/recovered.edits/12.seqid to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f/recovered.edits/12.seqid 2023-02-16 18:01:42,028 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/recovered.edits/12.seqid to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498/recovered.edits/12.seqid 2023-02-16 18:01:42,029 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/recovered.edits/12.seqid to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2/recovered.edits/12.seqid 2023-02-16 18:01:42,029 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/recovered.edits/12.seqid to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804/recovered.edits/12.seqid 2023-02-16 18:01:42,029 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/aeef298fd4c8182aec11e6f13fb1f498 2023-02-16 18:01:42,029 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/95c95ff4a3c7bc5bf657c871bd52be7f 2023-02-16 18:01:42,030 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/recovered.edits/12.seqid to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f/recovered.edits/12.seqid 2023-02-16 18:01:42,030 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/44bd149ba1e4dc457155e72145b92804 2023-02-16 18:01:42,030 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/a5cf4b56498ec7331bb3a0f533d41fc2 2023-02-16 18:01:42,030 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/e7445758c3b995e9c904d54090c0098f 2023-02-16 18:01:42,030 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/86f2541ba97be80de5233420d382624d/f1, FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/86f2541ba97be80de5233420d382624d/f2, FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/86f2541ba97be80de5233420d382624d/recovered.edits] 2023-02-16 18:01:42,036 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/f2/3277a1c065dd4847a6ddf33b8f182069 to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/f2/3277a1c065dd4847a6ddf33b8f182069 2023-02-16 18:01:42,037 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/f2/f58c8230c8a14d33907c5a9430d691ae to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/f2/f58c8230c8a14d33907c5a9430d691ae 2023-02-16 18:01:42,039 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/86f2541ba97be80de5233420d382624d/recovered.edits/6.seqid to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/86f2541ba97be80de5233420d382624d/recovered.edits/6.seqid 2023-02-16 18:01:42,040 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/recovered.edits/12.seqid to hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/archive/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9/recovered.edits/12.seqid 2023-02-16 18:01:42,040 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/86f2541ba97be80de5233420d382624d 2023-02-16 18:01:42,040 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/.tmp/data/default/testWithMockedMapReduceMultiRegion/777832e7eb6d1f4669aed8cac8c2cce9 2023-02-16 18:01:42,040 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-16 18:01:42,042 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:42,045 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-16 18:01:42,047 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-16 18:01:42,048 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:42,048 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-16 18:01:42,048 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676570502048"}]},"ts":"9223372036854775807"} 2023-02-16 18:01:42,048 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676570502048"}]},"ts":"9223372036854775807"} 2023-02-16 18:01:42,048 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676570497226.e7445758c3b995e9c904d54090c0098f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676570502048"}]},"ts":"9223372036854775807"} 2023-02-16 18:01:42,048 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676570502048"}]},"ts":"9223372036854775807"} 2023-02-16 18:01:42,048 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676570502048"}]},"ts":"9223372036854775807"} 2023-02-16 18:01:42,048 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676570497226.44bd149ba1e4dc457155e72145b92804.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676570502048"}]},"ts":"9223372036854775807"} 2023-02-16 18:01:42,048 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676570502048"}]},"ts":"9223372036854775807"} 2023-02-16 18:01:42,049 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676570502048"}]},"ts":"9223372036854775807"} 2023-02-16 18:01:42,049 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676570502048"}]},"ts":"9223372036854775807"} 2023-02-16 18:01:42,049 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676570502048"}]},"ts":"9223372036854775807"} 2023-02-16 18:01:42,051 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-16 18:01:42,051 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3b23ebcb7a063fa26cbc8e7ad4af5a30, NAME => 'testWithMockedMapReduceMultiRegion,,1676570497226.3b23ebcb7a063fa26cbc8e7ad4af5a30.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 95c95ff4a3c7bc5bf657c871bd52be7f, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676570497226.95c95ff4a3c7bc5bf657c871bd52be7f.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => e7445758c3b995e9c904d54090c0098f, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676570497226.e7445758c3b995e9c904d54090c0098f.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => aeef298fd4c8182aec11e6f13fb1f498, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676570497226.aeef298fd4c8182aec11e6f13fb1f498.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 664fd63b9893f58d619f365d46c359ac, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676570497226.664fd63b9893f58d619f365d46c359ac.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 44bd149ba1e4dc457155e72145b92804, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676570497226.44bd149ba1e4dc457155e72145b92804.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => a5cf4b56498ec7331bb3a0f533d41fc2, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676570497226.a5cf4b56498ec7331bb3a0f533d41fc2.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 92a7db0f18e3fd67d4c8e3c9b1bf61e5, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676570497226.92a7db0f18e3fd67d4c8e3c9b1bf61e5.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 777832e7eb6d1f4669aed8cac8c2cce9, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676570497226.777832e7eb6d1f4669aed8cac8c2cce9.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 86f2541ba97be80de5233420d382624d, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676570497226.86f2541ba97be80de5233420d382624d.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-16 18:01:42,051 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-16 18:01:42,051 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676570502051"}]},"ts":"9223372036854775807"} 2023-02-16 18:01:42,053 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-16 18:01:42,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-16 18:01:42,138 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-16 18:01:42,139 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 172 msec 2023-02-16 18:01:42,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36327] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-16 18:01:42,272 INFO [Listener at localhost/34831] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-16 18:01:42,272 INFO [Listener at localhost/34831] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-16 18:01:42,272 INFO [Listener at localhost/34831] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-16 18:01:42,272 DEBUG [Listener at localhost/34831] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b19c6a6 to 127.0.0.1:54761 2023-02-16 18:01:42,273 DEBUG [Listener at localhost/34831] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:42,273 DEBUG [Listener at localhost/34831] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-16 18:01:42,273 DEBUG [Listener at localhost/34831] util.JVMClusterUtil(257): Found active master hash=1942752761, stopped=false 2023-02-16 18:01:42,273 INFO [Listener at localhost/34831] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,36327,1676570495788 2023-02-16 18:01:42,391 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:42,391 INFO [Listener at localhost/34831] procedure2.ProcedureExecutor(629): Stopping 2023-02-16 18:01:42,391 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:36643-0x1005e4b74cd0002, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:42,391 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:35421-0x1005e4b74cd0001, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:42,391 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:42,393 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:42,393 DEBUG [Listener at localhost/34831] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x20050d77 to 127.0.0.1:54761 2023-02-16 18:01:42,393 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36643-0x1005e4b74cd0002, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:42,393 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35421-0x1005e4b74cd0001, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:42,393 DEBUG [Listener at localhost/34831] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:42,393 INFO [Listener at localhost/34831] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35421,1676570495840' ***** 2023-02-16 18:01:42,393 INFO [Listener at localhost/34831] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 18:01:42,394 INFO [Listener at localhost/34831] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36643,1676570495876' ***** 2023-02-16 18:01:42,394 INFO [Listener at localhost/34831] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 18:01:42,394 INFO [RS:1;jenkins-hbase4:36643] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 18:01:42,394 INFO [RS:0;jenkins-hbase4:35421] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 18:01:42,394 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 18:01:42,394 INFO [RS:1;jenkins-hbase4:36643] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 18:01:42,394 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 18:01:42,395 INFO [RS:1;jenkins-hbase4:36643] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 18:01:42,394 INFO [RS:0;jenkins-hbase4:35421] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 18:01:42,396 INFO [RS:1;jenkins-hbase4:36643] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:42,396 INFO [RS:0;jenkins-hbase4:35421] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 18:01:42,396 DEBUG [RS:1;jenkins-hbase4:36643] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2a2033b7 to 127.0.0.1:54761 2023-02-16 18:01:42,396 INFO [RS:0;jenkins-hbase4:35421] regionserver.HRegionServer(3304): Received CLOSE for e10a41981e221e4dbacc2fa2ec061c41 2023-02-16 18:01:42,396 DEBUG [RS:1;jenkins-hbase4:36643] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:42,396 INFO [RS:0;jenkins-hbase4:35421] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:42,396 INFO [RS:1;jenkins-hbase4:36643] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 18:01:42,396 INFO [RS:1;jenkins-hbase4:36643] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 18:01:42,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e10a41981e221e4dbacc2fa2ec061c41, disabling compactions & flushes 2023-02-16 18:01:42,396 DEBUG [RS:0;jenkins-hbase4:35421] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c312feb to 127.0.0.1:54761 2023-02-16 18:01:42,397 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676570496583.e10a41981e221e4dbacc2fa2ec061c41. 2023-02-16 18:01:42,397 INFO [RS:1;jenkins-hbase4:36643] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 18:01:42,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676570496583.e10a41981e221e4dbacc2fa2ec061c41. 2023-02-16 18:01:42,397 DEBUG [RS:0;jenkins-hbase4:35421] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:42,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676570496583.e10a41981e221e4dbacc2fa2ec061c41. after waiting 0 ms 2023-02-16 18:01:42,397 INFO [RS:0;jenkins-hbase4:35421] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-16 18:01:42,397 INFO [RS:1;jenkins-hbase4:36643] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-16 18:01:42,397 DEBUG [RS:0;jenkins-hbase4:35421] regionserver.HRegionServer(1479): Online Regions={e10a41981e221e4dbacc2fa2ec061c41=hbase:namespace,,1676570496583.e10a41981e221e4dbacc2fa2ec061c41.} 2023-02-16 18:01:42,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676570496583.e10a41981e221e4dbacc2fa2ec061c41. 2023-02-16 18:01:42,397 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing e10a41981e221e4dbacc2fa2ec061c41 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-16 18:01:42,397 DEBUG [RS:0;jenkins-hbase4:35421] regionserver.HRegionServer(1505): Waiting on e10a41981e221e4dbacc2fa2ec061c41 2023-02-16 18:01:42,397 INFO [RS:1;jenkins-hbase4:36643] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-16 18:01:42,398 DEBUG [RS:1;jenkins-hbase4:36643] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-16 18:01:42,398 DEBUG [RS:1;jenkins-hbase4:36643] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-16 18:01:42,400 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 18:01:42,400 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 18:01:42,400 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 18:01:42,400 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 18:01:42,400 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 18:01:42,400 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 18:01:42,400 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.36 KB heapSize=44.48 KB 2023-02-16 18:01:42,422 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/hbase/namespace/e10a41981e221e4dbacc2fa2ec061c41/.tmp/info/fbcc469491ea43c180202ff2f51b53b2 2023-02-16 18:01:42,422 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.73 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/hbase/meta/1588230740/.tmp/info/edea4275c52449a28fb6e67689283b57 2023-02-16 18:01:42,424 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 18:01:42,427 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for edea4275c52449a28fb6e67689283b57 2023-02-16 18:01:42,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/hbase/namespace/e10a41981e221e4dbacc2fa2ec061c41/.tmp/info/fbcc469491ea43c180202ff2f51b53b2 as hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/hbase/namespace/e10a41981e221e4dbacc2fa2ec061c41/info/fbcc469491ea43c180202ff2f51b53b2 2023-02-16 18:01:42,431 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/hbase/namespace/e10a41981e221e4dbacc2fa2ec061c41/info/fbcc469491ea43c180202ff2f51b53b2, entries=2, sequenceid=6, filesize=4.8 K 2023-02-16 18:01:42,432 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for e10a41981e221e4dbacc2fa2ec061c41 in 35ms, sequenceid=6, compaction requested=false 2023-02-16 18:01:42,434 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/hbase/meta/1588230740/.tmp/rep_barrier/3beed353611b44428b3234be36496f09 2023-02-16 18:01:42,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/hbase/namespace/e10a41981e221e4dbacc2fa2ec061c41/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-16 18:01:42,437 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676570496583.e10a41981e221e4dbacc2fa2ec061c41. 2023-02-16 18:01:42,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e10a41981e221e4dbacc2fa2ec061c41: 2023-02-16 18:01:42,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676570496583.e10a41981e221e4dbacc2fa2ec061c41. 2023-02-16 18:01:42,439 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3beed353611b44428b3234be36496f09 2023-02-16 18:01:42,446 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/hbase/meta/1588230740/.tmp/table/15cdfd5d4df744caa9e52ca327397917 2023-02-16 18:01:42,449 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 15cdfd5d4df744caa9e52ca327397917 2023-02-16 18:01:42,449 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/hbase/meta/1588230740/.tmp/info/edea4275c52449a28fb6e67689283b57 as hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/hbase/meta/1588230740/info/edea4275c52449a28fb6e67689283b57 2023-02-16 18:01:42,452 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for edea4275c52449a28fb6e67689283b57 2023-02-16 18:01:42,452 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/hbase/meta/1588230740/info/edea4275c52449a28fb6e67689283b57, entries=30, sequenceid=57, filesize=8.3 K 2023-02-16 18:01:42,453 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/hbase/meta/1588230740/.tmp/rep_barrier/3beed353611b44428b3234be36496f09 as hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/hbase/meta/1588230740/rep_barrier/3beed353611b44428b3234be36496f09 2023-02-16 18:01:42,456 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3beed353611b44428b3234be36496f09 2023-02-16 18:01:42,456 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/hbase/meta/1588230740/rep_barrier/3beed353611b44428b3234be36496f09, entries=10, sequenceid=57, filesize=6.1 K 2023-02-16 18:01:42,457 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/hbase/meta/1588230740/.tmp/table/15cdfd5d4df744caa9e52ca327397917 as hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/hbase/meta/1588230740/table/15cdfd5d4df744caa9e52ca327397917 2023-02-16 18:01:42,460 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 15cdfd5d4df744caa9e52ca327397917 2023-02-16 18:01:42,460 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/hbase/meta/1588230740/table/15cdfd5d4df744caa9e52ca327397917, entries=13, sequenceid=57, filesize=6.1 K 2023-02-16 18:01:42,461 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 60ms, sequenceid=57, compaction requested=false 2023-02-16 18:01:42,464 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-16 18:01:42,464 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 18:01:42,465 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 18:01:42,465 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 18:01:42,466 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-16 18:01:42,598 INFO [RS:0;jenkins-hbase4:35421] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35421,1676570495840; all regions closed. 2023-02-16 18:01:42,600 INFO [RS:1;jenkins-hbase4:36643] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36643,1676570495876; all regions closed. 2023-02-16 18:01:42,606 DEBUG [RS:0;jenkins-hbase4:35421] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/oldWALs 2023-02-16 18:01:42,606 INFO [RS:0;jenkins-hbase4:35421] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35421%2C1676570495840:(num 1676570496960) 2023-02-16 18:01:42,606 DEBUG [RS:0;jenkins-hbase4:35421] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:42,606 INFO [RS:0;jenkins-hbase4:35421] regionserver.LeaseManager(133): Closed leases 2023-02-16 18:01:42,607 INFO [RS:0;jenkins-hbase4:35421] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-16 18:01:42,607 DEBUG [RS:1;jenkins-hbase4:36643] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/oldWALs 2023-02-16 18:01:42,607 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 18:01:42,607 INFO [RS:0;jenkins-hbase4:35421] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 18:01:42,607 INFO [RS:1;jenkins-hbase4:36643] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36643%2C1676570495876.meta:.meta(num 1676570496474) 2023-02-16 18:01:42,607 INFO [RS:0;jenkins-hbase4:35421] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 18:01:42,607 INFO [RS:0;jenkins-hbase4:35421] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 18:01:42,609 INFO [RS:0;jenkins-hbase4:35421] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35421 2023-02-16 18:01:42,612 DEBUG [RS:1;jenkins-hbase4:36643] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/oldWALs 2023-02-16 18:01:42,612 INFO [RS:1;jenkins-hbase4:36643] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36643%2C1676570495876:(num 1676570497228) 2023-02-16 18:01:42,612 DEBUG [RS:1;jenkins-hbase4:36643] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:42,612 INFO [RS:1;jenkins-hbase4:36643] regionserver.LeaseManager(133): Closed leases 2023-02-16 18:01:42,612 INFO [RS:1;jenkins-hbase4:36643] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-16 18:01:42,612 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 18:01:42,613 INFO [RS:1;jenkins-hbase4:36643] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36643 2023-02-16 18:01:42,676 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:42,676 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:36643-0x1005e4b74cd0002, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:42,676 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:35421-0x1005e4b74cd0001, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35421,1676570495840 2023-02-16 18:01:42,676 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:36643-0x1005e4b74cd0002, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:42,676 ERROR [Listener at localhost/34831-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@31ddc09b rejected from java.util.concurrent.ThreadPoolExecutor@35e24278[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:42,676 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:35421-0x1005e4b74cd0001, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:42,676 ERROR [Listener at localhost/34831-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1edcffdd rejected from java.util.concurrent.ThreadPoolExecutor@35e24278[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:42,776 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:35421-0x1005e4b74cd0001, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:42,776 ERROR [Listener at localhost/34831-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@660c5644 rejected from java.util.concurrent.ThreadPoolExecutor@35e24278[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:42,776 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:36643-0x1005e4b74cd0002, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36643,1676570495876 2023-02-16 18:01:42,776 ERROR [Listener at localhost/34831-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1c6ac0af rejected from java.util.concurrent.ThreadPoolExecutor@185547fa[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:42,845 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35421,1676570495840] 2023-02-16 18:01:42,845 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35421,1676570495840; numProcessing=1 2023-02-16 18:01:42,946 INFO [RS:0;jenkins-hbase4:35421] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35421,1676570495840; zookeeper connection closed. 2023-02-16 18:01:42,946 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:35421-0x1005e4b74cd0001, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:42,946 ERROR [Listener at localhost/34831-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6914123c rejected from java.util.concurrent.ThreadPoolExecutor@35e24278[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:42,946 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:35421-0x1005e4b74cd0001, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:42,946 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4f63e457] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4f63e457 2023-02-16 18:01:42,946 ERROR [Listener at localhost/34831-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7d08fb9a rejected from java.util.concurrent.ThreadPoolExecutor@35e24278[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:42,977 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35421,1676570495840 already deleted, retry=false 2023-02-16 18:01:42,977 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35421,1676570495840 expired; onlineServers=1 2023-02-16 18:01:42,977 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36643,1676570495876] 2023-02-16 18:01:42,977 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36643,1676570495876; numProcessing=2 2023-02-16 18:01:43,046 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:36643-0x1005e4b74cd0002, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:43,046 INFO [RS:1;jenkins-hbase4:36643] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36643,1676570495876; zookeeper connection closed. 2023-02-16 18:01:43,046 ERROR [Listener at localhost/34831-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@266574c8 rejected from java.util.concurrent.ThreadPoolExecutor@185547fa[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:43,046 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): regionserver:36643-0x1005e4b74cd0002, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:43,046 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@74278f2] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@74278f2 2023-02-16 18:01:43,046 ERROR [Listener at localhost/34831-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5e9857f6 rejected from java.util.concurrent.ThreadPoolExecutor@185547fa[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:43,046 INFO [Listener at localhost/34831] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-16 18:01:43,069 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36643,1676570495876 already deleted, retry=false 2023-02-16 18:01:43,069 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36643,1676570495876 expired; onlineServers=0 2023-02-16 18:01:43,069 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36327,1676570495788' ***** 2023-02-16 18:01:43,069 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-16 18:01:43,070 DEBUG [M:0;jenkins-hbase4:36327] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77f38758, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 18:01:43,070 INFO [M:0;jenkins-hbase4:36327] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36327,1676570495788 2023-02-16 18:01:43,070 INFO [M:0;jenkins-hbase4:36327] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36327,1676570495788; all regions closed. 2023-02-16 18:01:43,070 DEBUG [M:0;jenkins-hbase4:36327] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:43,070 DEBUG [M:0;jenkins-hbase4:36327] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-16 18:01:43,070 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-16 18:01:43,070 DEBUG [M:0;jenkins-hbase4:36327] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-16 18:01:43,070 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676570496099] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676570496099,5,FailOnTimeoutGroup] 2023-02-16 18:01:43,070 INFO [M:0;jenkins-hbase4:36327] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-16 18:01:43,070 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676570496099] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676570496099,5,FailOnTimeoutGroup] 2023-02-16 18:01:43,071 INFO [M:0;jenkins-hbase4:36327] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-16 18:01:43,071 INFO [M:0;jenkins-hbase4:36327] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-16 18:01:43,071 DEBUG [M:0;jenkins-hbase4:36327] master.HMaster(1512): Stopping service threads 2023-02-16 18:01:43,072 INFO [M:0;jenkins-hbase4:36327] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-16 18:01:43,072 ERROR [M:0;jenkins-hbase4:36327] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-16 18:01:43,072 INFO [M:0;jenkins-hbase4:36327] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-16 18:01:43,072 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-16 18:01:43,122 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-16 18:01:43,122 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:43,122 DEBUG [M:0;jenkins-hbase4:36327] zookeeper.ZKUtil(398): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-16 18:01:43,122 WARN [M:0;jenkins-hbase4:36327] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-16 18:01:43,122 INFO [M:0;jenkins-hbase4:36327] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-16 18:01:43,123 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 18:01:43,123 INFO [M:0;jenkins-hbase4:36327] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-16 18:01:43,123 DEBUG [M:0;jenkins-hbase4:36327] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 18:01:43,123 INFO [M:0;jenkins-hbase4:36327] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:43,123 DEBUG [M:0;jenkins-hbase4:36327] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:43,123 DEBUG [M:0;jenkins-hbase4:36327] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 18:01:43,123 DEBUG [M:0;jenkins-hbase4:36327] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:43,123 INFO [M:0;jenkins-hbase4:36327] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.14 KB heapSize=200.04 KB 2023-02-16 18:01:43,132 INFO [M:0;jenkins-hbase4:36327] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.14 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7d72d808ead3423b8736e7e3bcabb73c 2023-02-16 18:01:43,135 DEBUG [M:0;jenkins-hbase4:36327] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7d72d808ead3423b8736e7e3bcabb73c as hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7d72d808ead3423b8736e7e3bcabb73c 2023-02-16 18:01:43,139 INFO [M:0;jenkins-hbase4:36327] regionserver.HStore(1080): Added hdfs://localhost:40013/user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7d72d808ead3423b8736e7e3bcabb73c, entries=53, sequenceid=357, filesize=10.7 K 2023-02-16 18:01:43,139 INFO [M:0;jenkins-hbase4:36327] regionserver.HRegion(2947): Finished flush of dataSize ~167.14 KB/171150, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=357, compaction requested=false 2023-02-16 18:01:43,140 INFO [M:0;jenkins-hbase4:36327] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:43,140 DEBUG [M:0;jenkins-hbase4:36327] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 18:01:43,150 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/457d1a3f-a7c8-3086-d25a-7459af5a3dee/MasterData/WALs/jenkins-hbase4.apache.org,36327,1676570495788/jenkins-hbase4.apache.org%2C36327%2C1676570495788.1676570496012 not finished, retry = 0 2023-02-16 18:01:43,251 INFO [M:0;jenkins-hbase4:36327] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-16 18:01:43,251 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 18:01:43,253 INFO [M:0;jenkins-hbase4:36327] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36327 2023-02-16 18:01:43,276 DEBUG [M:0;jenkins-hbase4:36327] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,36327,1676570495788 already deleted, retry=false 2023-02-16 18:01:43,445 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:43,445 INFO [M:0;jenkins-hbase4:36327] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36327,1676570495788; zookeeper connection closed. 2023-02-16 18:01:43,445 ERROR [Listener at localhost/34831-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@34ce4095 rejected from java.util.concurrent.ThreadPoolExecutor@30f1c2d4[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:43,446 DEBUG [Listener at localhost/34831-EventThread] zookeeper.ZKWatcher(600): master:36327-0x1005e4b74cd0000, quorum=127.0.0.1:54761, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:43,446 ERROR [Listener at localhost/34831-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@240893d rejected from java.util.concurrent.ThreadPoolExecutor@30f1c2d4[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:43,446 WARN [Listener at localhost/34831] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 18:01:43,463 INFO [Listener at localhost/34831] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 18:01:43,571 WARN [BP-1091722399-172.31.14.131-1676570495091 heartbeating to localhost/127.0.0.1:40013] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 18:01:43,571 WARN [BP-1091722399-172.31.14.131-1676570495091 heartbeating to localhost/127.0.0.1:40013] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1091722399-172.31.14.131-1676570495091 (Datanode Uuid 54fd46bd-9ace-4eb2-b83c-34e8b538a34b) service to localhost/127.0.0.1:40013 2023-02-16 18:01:43,571 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/661ccbb0-5b8f-013c-bd3e-089e158f2c8e/cluster_9e9909f0-0933-c29b-2a4a-ccd4da4decaf/dfs/data/data3/current/BP-1091722399-172.31.14.131-1676570495091] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 18:01:43,572 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/661ccbb0-5b8f-013c-bd3e-089e158f2c8e/cluster_9e9909f0-0933-c29b-2a4a-ccd4da4decaf/dfs/data/data4/current/BP-1091722399-172.31.14.131-1676570495091] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 18:01:43,573 WARN [Listener at localhost/34831] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 18:01:43,578 INFO [Listener at localhost/34831] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 18:01:43,683 WARN [BP-1091722399-172.31.14.131-1676570495091 heartbeating to localhost/127.0.0.1:40013] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 18:01:43,683 WARN [BP-1091722399-172.31.14.131-1676570495091 heartbeating to localhost/127.0.0.1:40013] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1091722399-172.31.14.131-1676570495091 (Datanode Uuid 6f163c0e-00e6-470e-8586-4840f027debf) service to localhost/127.0.0.1:40013 2023-02-16 18:01:43,686 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/661ccbb0-5b8f-013c-bd3e-089e158f2c8e/cluster_9e9909f0-0933-c29b-2a4a-ccd4da4decaf/dfs/data/data1/current/BP-1091722399-172.31.14.131-1676570495091] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 18:01:43,686 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/661ccbb0-5b8f-013c-bd3e-089e158f2c8e/cluster_9e9909f0-0933-c29b-2a4a-ccd4da4decaf/dfs/data/data2/current/BP-1091722399-172.31.14.131-1676570495091] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 18:01:43,698 INFO [Listener at localhost/34831] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 18:01:43,818 INFO [Listener at localhost/34831] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-16 18:01:43,858 INFO [Listener at localhost/34831] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-16 18:01:43,873 INFO [Listener at localhost/34831] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=228 (was 178) Potentially hanging thread: Listener at localhost/34831.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:40013 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34831.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1124632911) connection to localhost/127.0.0.1:40013 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34831.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34831.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost:40013 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34831.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1124632911) connection to localhost/127.0.0.1:40013 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1124632911) connection to localhost/127.0.0.1:40013 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/34831.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost:40013 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34831 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34831.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34831.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34831.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1124632911) connection to localhost/127.0.0.1:40013 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase4.apache.org,36327,1676570495788)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34831.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=637 (was 571) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=281 (was 296), ProcessCount=170 (was 170), AvailableMemoryMB=1199 (was 1385) 2023-02-16 18:01:43,884 INFO [Listener at localhost/34831] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=228, OpenFileDescriptor=637, MaxFileDescriptor=60000, SystemLoadAverage=281, ProcessCount=170, AvailableMemoryMB=1200 2023-02-16 18:01:43,894 INFO [Listener at localhost/34831] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/661ccbb0-5b8f-013c-bd3e-089e158f2c8e/hadoop.log.dir so I do NOT create it in target/test-data/07dde6f3-a48b-c203-4130-4ef7675c69c6 2023-02-16 18:01:43,894 WARN [Listener at localhost/34831] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/661ccbb0-5b8f-013c-bd3e-089e158f2c8e/hadoop.log.dir Erasing configuration value by system value. 2023-02-16 18:01:43,894 INFO [Listener at localhost/34831] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/661ccbb0-5b8f-013c-bd3e-089e158f2c8e/hadoop.tmp.dir so I do NOT create it in target/test-data/07dde6f3-a48b-c203-4130-4ef7675c69c6 2023-02-16 18:01:43,894 WARN [Listener at localhost/34831] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/661ccbb0-5b8f-013c-bd3e-089e158f2c8e/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-16 18:01:43,894 DEBUG [Listener at localhost/34831] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07dde6f3-a48b-c203-4130-4ef7675c69c6 2023-02-16 18:01:43,894 INFO [Listener at localhost/34831] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-16 18:01:43,894 INFO [Listener at localhost/34831] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07dde6f3-a48b-c203-4130-4ef7675c69c6/cluster_879cd88e-8801-043b-c58a-e39e57b604b1, deleteOnExit=true 2023-02-16 18:01:43,894 INFO [Listener at localhost/34831] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-16 18:01:43,894 INFO [Listener at localhost/34831] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07dde6f3-a48b-c203-4130-4ef7675c69c6/test.cache.data in system properties and HBase conf 2023-02-16 18:01:43,895 INFO [Listener at localhost/34831] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07dde6f3-a48b-c203-4130-4ef7675c69c6/hadoop.tmp.dir in system properties and HBase conf 2023-02-16 18:01:43,895 INFO [Listener at localhost/34831] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07dde6f3-a48b-c203-4130-4ef7675c69c6/hadoop.log.dir in system properties and HBase conf 2023-02-16 18:01:43,895 INFO [Listener at localhost/34831] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07dde6f3-a48b-c203-4130-4ef7675c69c6/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-16 18:01:43,895 INFO [Listener at localhost/34831] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07dde6f3-a48b-c203-4130-4ef7675c69c6/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-16 18:01:43,895 INFO [Listener at localhost/34831] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-16 18:01:43,895 DEBUG [Listener at localhost/34831] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-16 18:01:43,895 INFO [Listener at localhost/34831] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07dde6f3-a48b-c203-4130-4ef7675c69c6/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-16 18:01:43,895 INFO [Listener at localhost/34831] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07dde6f3-a48b-c203-4130-4ef7675c69c6/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-16 18:01:43,895 INFO [Listener at localhost/34831] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07dde6f3-a48b-c203-4130-4ef7675c69c6/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-16 18:01:43,896 INFO [Listener at localhost/34831] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07dde6f3-a48b-c203-4130-4ef7675c69c6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 18:01:43,896 INFO [Listener at localhost/34831] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07dde6f3-a48b-c203-4130-4ef7675c69c6/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-16 18:01:43,896 INFO [Listener at localhost/34831] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07dde6f3-a48b-c203-4130-4ef7675c69c6/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-16 18:01:43,896 INFO [Listener at localhost/34831] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07dde6f3-a48b-c203-4130-4ef7675c69c6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 18:01:43,896 INFO [Listener at localhost/34831] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07dde6f3-a48b-c203-4130-4ef7675c69c6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 18:01:43,896 INFO [Listener at localhost/34831] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07dde6f3-a48b-c203-4130-4ef7675c69c6/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-16 18:01:43,896 INFO [Listener at localhost/34831] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07dde6f3-a48b-c203-4130-4ef7675c69c6/nfs.dump.dir in system properties and HBase conf 2023-02-16 18:01:43,896 INFO [Listener at localhost/34831] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07dde6f3-a48b-c203-4130-4ef7675c69c6/java.io.tmpdir in system properties and HBase conf 2023-02-16 18:01:43,896 INFO [Listener at localhost/34831] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07dde6f3-a48b-c203-4130-4ef7675c69c6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 18:01:43,896 INFO [Listener at localhost/34831] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07dde6f3-a48b-c203-4130-4ef7675c69c6/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-16 18:01:43,896 INFO [Listener at localhost/34831] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07dde6f3-a48b-c203-4130-4ef7675c69c6/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-16 18:01:43,900 WARN [Listener at localhost/34831] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 18:01:43,900 WARN [Listener at localhost/34831] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 18:01:43,964 WARN [Listener at localhost/34831] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 18:01:43,967 INFO [Listener at localhost/34831] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 18:01:43,972 INFO [Listener at localhost/34831] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07dde6f3-a48b-c203-4130-4ef7675c69c6/java.io.tmpdir/Jetty_localhost_32995_hdfs____xoqups/webapp 2023-02-16 18:01:44,063 INFO [Listener at localhost/34831] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:32995 2023-02-16 18:01:44,068 WARN [Listener at localhost/34831] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 18:01:44,068 WARN [Listener at localhost/34831] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 18:01:44,106 WARN [Listener at localhost/37837] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 18:01:44,117 WARN [Listener at localhost/37837] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 18:01:44,119 WARN [Listener at localhost/37837] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 18:01:44,120 INFO [Listener at localhost/37837] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 18:01:44,125 INFO [Listener at localhost/37837] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07dde6f3-a48b-c203-4130-4ef7675c69c6/java.io.tmpdir/Jetty_localhost_36647_datanode____ma43q5/webapp 2023-02-16 18:01:44,222 INFO [Listener at localhost/37837] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36647 2023-02-16 18:01:44,234 WARN [Listener at localhost/34217] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 18:01:44,254 WARN [Listener at localhost/34217] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 18:01:44,257 WARN [Listener at localhost/34217] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 18:01:44,258 INFO [Listener at localhost/34217] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 18:01:44,262 INFO [Listener at localhost/34217] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07dde6f3-a48b-c203-4130-4ef7675c69c6/java.io.tmpdir/Jetty_localhost_43157_datanode____801ml7/webapp 2023-02-16 18:01:44,328 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3be70b4a7581b99b: Processing first storage report for DS-ad42dffb-7860-48a6-93ba-cf0d0a06e556 from datanode 4b5a5bf5-ab46-425f-a7ef-fc87d4ba6f5a 2023-02-16 18:01:44,328 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3be70b4a7581b99b: from storage DS-ad42dffb-7860-48a6-93ba-cf0d0a06e556 node DatanodeRegistration(127.0.0.1:33869, datanodeUuid=4b5a5bf5-ab46-425f-a7ef-fc87d4ba6f5a, infoPort=38069, infoSecurePort=0, ipcPort=34217, storageInfo=lv=-57;cid=testClusterID;nsid=1010602161;c=1676570503903), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 18:01:44,328 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3be70b4a7581b99b: Processing first storage report for DS-ff421451-600a-44fc-a1b5-4a718bdae46b from datanode 4b5a5bf5-ab46-425f-a7ef-fc87d4ba6f5a 2023-02-16 18:01:44,328 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3be70b4a7581b99b: from storage DS-ff421451-600a-44fc-a1b5-4a718bdae46b node DatanodeRegistration(127.0.0.1:33869, datanodeUuid=4b5a5bf5-ab46-425f-a7ef-fc87d4ba6f5a, infoPort=38069, infoSecurePort=0, ipcPort=34217, storageInfo=lv=-57;cid=testClusterID;nsid=1010602161;c=1676570503903), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 18:01:44,360 INFO [Listener at localhost/34217] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43157 2023-02-16 18:01:44,368 WARN [Listener at localhost/34323] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 18:01:44,582 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x600a8ed73d134ec9: Processing first storage report for DS-01a84b9e-683a-418b-924f-376c5b3e1b87 from datanode f9e07f23-4cd8-4e65-bbbc-cc5409b820f5 2023-02-16 18:01:44,582 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x600a8ed73d134ec9: from storage DS-01a84b9e-683a-418b-924f-376c5b3e1b87 node DatanodeRegistration(127.0.0.1:34495, datanodeUuid=f9e07f23-4cd8-4e65-bbbc-cc5409b820f5, infoPort=40297, infoSecurePort=0, ipcPort=34323, storageInfo=lv=-57;cid=testClusterID;nsid=1010602161;c=1676570503903), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 18:01:44,582 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x600a8ed73d134ec9: Processing first storage report for DS-ecebe021-9413-4212-a84a-5d6d0f13200c from datanode f9e07f23-4cd8-4e65-bbbc-cc5409b820f5 2023-02-16 18:01:44,582 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x600a8ed73d134ec9: from storage DS-ecebe021-9413-4212-a84a-5d6d0f13200c node DatanodeRegistration(127.0.0.1:34495, datanodeUuid=f9e07f23-4cd8-4e65-bbbc-cc5409b820f5, infoPort=40297, infoSecurePort=0, ipcPort=34323, storageInfo=lv=-57;cid=testClusterID;nsid=1010602161;c=1676570503903), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 18:01:44,681 DEBUG [Listener at localhost/34323] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07dde6f3-a48b-c203-4130-4ef7675c69c6 2023-02-16 18:01:44,683 INFO [Listener at localhost/34323] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07dde6f3-a48b-c203-4130-4ef7675c69c6/cluster_879cd88e-8801-043b-c58a-e39e57b604b1/zookeeper_0, clientPort=50386, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07dde6f3-a48b-c203-4130-4ef7675c69c6/cluster_879cd88e-8801-043b-c58a-e39e57b604b1/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07dde6f3-a48b-c203-4130-4ef7675c69c6/cluster_879cd88e-8801-043b-c58a-e39e57b604b1/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-16 18:01:44,684 INFO [Listener at localhost/34323] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=50386 2023-02-16 18:01:44,685 INFO [Listener at localhost/34323] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:44,685 INFO [Listener at localhost/34323] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:44,697 INFO [Listener at localhost/34323] util.FSUtils(479): Created version file at hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c with version=8 2023-02-16 18:01:44,697 INFO [Listener at localhost/34323] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:44,698 INFO [Listener at localhost/34323] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:44,699 INFO [Listener at localhost/34323] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:37837/user/jenkins/test-data/7e86229c-4b5f-576a-d817-000cf8fd0384/hbase-staging 2023-02-16 18:01:44,700 INFO [Listener at localhost/34323] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 18:01:44,700 INFO [Listener at localhost/34323] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:44,700 INFO [Listener at localhost/34323] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:44,700 INFO [Listener at localhost/34323] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 18:01:44,701 INFO [Listener at localhost/34323] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:44,701 INFO [Listener at localhost/34323] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 18:01:44,701 INFO [Listener at localhost/34323] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 18:01:44,701 INFO [Listener at localhost/34323] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45797 2023-02-16 18:01:44,701 INFO [Listener at localhost/34323] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:44,702 INFO [Listener at localhost/34323] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:44,703 INFO [Listener at localhost/34323] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45797 connecting to ZooKeeper ensemble=127.0.0.1:50386 2023-02-16 18:01:44,710 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:457970x0, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 18:01:44,711 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:45797-0x1005e4b97b00000 connected 2023-02-16 18:01:44,724 DEBUG [Listener at localhost/34323] zookeeper.ZKUtil(164): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 18:01:44,724 DEBUG [Listener at localhost/34323] zookeeper.ZKUtil(164): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:44,724 DEBUG [Listener at localhost/34323] zookeeper.ZKUtil(164): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 18:01:44,725 DEBUG [Listener at localhost/34323] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45797 2023-02-16 18:01:44,725 DEBUG [Listener at localhost/34323] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45797 2023-02-16 18:01:44,725 DEBUG [Listener at localhost/34323] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45797 2023-02-16 18:01:44,725 DEBUG [Listener at localhost/34323] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45797 2023-02-16 18:01:44,726 DEBUG [Listener at localhost/34323] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45797 2023-02-16 18:01:44,726 INFO [Listener at localhost/34323] master.HMaster(444): hbase.rootdir=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c, hbase.cluster.distributed=false 2023-02-16 18:01:44,738 INFO [Listener at localhost/34323] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 18:01:44,738 INFO [Listener at localhost/34323] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:44,738 INFO [Listener at localhost/34323] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:44,738 INFO [Listener at localhost/34323] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 18:01:44,738 INFO [Listener at localhost/34323] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:44,738 INFO [Listener at localhost/34323] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 18:01:44,738 INFO [Listener at localhost/34323] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 18:01:44,739 INFO [Listener at localhost/34323] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33823 2023-02-16 18:01:44,739 INFO [Listener at localhost/34323] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 18:01:44,742 DEBUG [Listener at localhost/34323] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:44,742 INFO [Listener at localhost/34323] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:44,743 INFO [Listener at localhost/34323] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:44,744 INFO [Listener at localhost/34323] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33823 connecting to ZooKeeper ensemble=127.0.0.1:50386 2023-02-16 18:01:44,748 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:338230x0, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 18:01:44,750 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:33823-0x1005e4b97b00001 connected 2023-02-16 18:01:44,750 DEBUG [Listener at localhost/34323] zookeeper.ZKUtil(164): regionserver:33823-0x1005e4b97b00001, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 18:01:44,750 DEBUG [Listener at localhost/34323] zookeeper.ZKUtil(164): regionserver:33823-0x1005e4b97b00001, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:44,751 DEBUG [Listener at localhost/34323] zookeeper.ZKUtil(164): regionserver:33823-0x1005e4b97b00001, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 18:01:44,753 DEBUG [Listener at localhost/34323] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33823 2023-02-16 18:01:44,753 DEBUG [Listener at localhost/34323] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33823 2023-02-16 18:01:44,753 DEBUG [Listener at localhost/34323] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33823 2023-02-16 18:01:44,753 DEBUG [Listener at localhost/34323] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33823 2023-02-16 18:01:44,754 DEBUG [Listener at localhost/34323] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33823 2023-02-16 18:01:44,765 INFO [Listener at localhost/34323] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 18:01:44,765 INFO [Listener at localhost/34323] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:44,765 INFO [Listener at localhost/34323] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:44,765 INFO [Listener at localhost/34323] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 18:01:44,765 INFO [Listener at localhost/34323] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:44,765 INFO [Listener at localhost/34323] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 18:01:44,765 INFO [Listener at localhost/34323] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 18:01:44,766 INFO [Listener at localhost/34323] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39705 2023-02-16 18:01:44,766 INFO [Listener at localhost/34323] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 18:01:44,767 DEBUG [Listener at localhost/34323] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:44,767 INFO [Listener at localhost/34323] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:44,768 INFO [Listener at localhost/34323] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:44,769 INFO [Listener at localhost/34323] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39705 connecting to ZooKeeper ensemble=127.0.0.1:50386 2023-02-16 18:01:44,773 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:397050x0, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 18:01:44,774 DEBUG [Listener at localhost/34323] zookeeper.ZKUtil(164): regionserver:397050x0, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 18:01:44,775 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:39705-0x1005e4b97b00002 connected 2023-02-16 18:01:44,775 DEBUG [Listener at localhost/34323] zookeeper.ZKUtil(164): regionserver:39705-0x1005e4b97b00002, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:44,776 DEBUG [Listener at localhost/34323] zookeeper.ZKUtil(164): regionserver:39705-0x1005e4b97b00002, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 18:01:44,776 DEBUG [Listener at localhost/34323] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39705 2023-02-16 18:01:44,777 DEBUG [Listener at localhost/34323] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39705 2023-02-16 18:01:44,777 DEBUG [Listener at localhost/34323] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39705 2023-02-16 18:01:44,778 DEBUG [Listener at localhost/34323] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39705 2023-02-16 18:01:44,780 DEBUG [Listener at localhost/34323] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39705 2023-02-16 18:01:44,782 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,45797,1676570504700 2023-02-16 18:01:44,784 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 18:01:44,785 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,45797,1676570504700 2023-02-16 18:01:44,787 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:33823-0x1005e4b97b00001, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 18:01:44,787 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x1005e4b97b00002, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 18:01:44,787 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 18:01:44,787 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:44,790 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 18:01:44,790 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 18:01:44,791 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,45797,1676570504700 from backup master directory 2023-02-16 18:01:44,792 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 18:01:44,792 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,45797,1676570504700 2023-02-16 18:01:44,793 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,45797,1676570504700 2023-02-16 18:01:44,793 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 18:01:44,816 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/hbase.id with ID: 7844244b-5b13-4ca7-b3df-fdf049b4716e 2023-02-16 18:01:44,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:44,826 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:44,832 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x305c5457 to 127.0.0.1:50386 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 18:01:44,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6fc1b80f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 18:01:44,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 18:01:44,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-16 18:01:44,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 18:01:44,838 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/MasterData/data/master/store-tmp 2023-02-16 18:01:44,843 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:44,843 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 18:01:44,843 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:44,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:44,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 18:01:44,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:44,844 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:44,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 18:01:44,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/MasterData/WALs/jenkins-hbase4.apache.org,45797,1676570504700 2023-02-16 18:01:44,846 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45797%2C1676570504700, suffix=, logDir=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/MasterData/WALs/jenkins-hbase4.apache.org,45797,1676570504700, archiveDir=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/MasterData/oldWALs, maxLogs=10 2023-02-16 18:01:44,858 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34495,DS-01a84b9e-683a-418b-924f-376c5b3e1b87,DISK] 2023-02-16 18:01:44,858 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33869,DS-ad42dffb-7860-48a6-93ba-cf0d0a06e556,DISK] 2023-02-16 18:01:44,860 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/MasterData/WALs/jenkins-hbase4.apache.org,45797,1676570504700/jenkins-hbase4.apache.org%2C45797%2C1676570504700.1676570504846 2023-02-16 18:01:44,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34495,DS-01a84b9e-683a-418b-924f-376c5b3e1b87,DISK], DatanodeInfoWithStorage[127.0.0.1:33869,DS-ad42dffb-7860-48a6-93ba-cf0d0a06e556,DISK]] 2023-02-16 18:01:44,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-16 18:01:44,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:44,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:44,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:44,861 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:44,862 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-16 18:01:44,862 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-16 18:01:44,863 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:44,863 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:44,864 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:44,866 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:44,867 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:44,867 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64783471, jitterRate=-0.03465105593204498}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 18:01:44,867 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 18:01:44,868 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-16 18:01:44,869 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-16 18:01:44,869 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-16 18:01:44,869 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-16 18:01:44,869 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-16 18:01:44,869 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-16 18:01:44,870 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-16 18:01:44,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-16 18:01:44,871 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-16 18:01:44,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-16 18:01:44,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-16 18:01:44,881 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-16 18:01:44,881 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-16 18:01:44,881 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-16 18:01:44,883 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:44,883 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-16 18:01:44,883 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-16 18:01:44,884 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-16 18:01:44,885 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:44,885 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:33823-0x1005e4b97b00001, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:44,885 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:44,885 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x1005e4b97b00002, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:44,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,45797,1676570504700, sessionid=0x1005e4b97b00000, setting cluster-up flag (Was=false) 2023-02-16 18:01:44,893 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:44,896 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-16 18:01:44,896 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45797,1676570504700 2023-02-16 18:01:44,900 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:44,904 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-16 18:01:44,904 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45797,1676570504700 2023-02-16 18:01:44,905 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/.hbase-snapshot/.tmp 2023-02-16 18:01:44,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-16 18:01:44,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 18:01:44,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 18:01:44,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 18:01:44,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 18:01:44,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-16 18:01:44,907 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:44,907 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 18:01:44,907 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:44,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676570534908 2023-02-16 18:01:44,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-16 18:01:44,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-16 18:01:44,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-16 18:01:44,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-16 18:01:44,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-16 18:01:44,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-16 18:01:44,909 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 18:01:44,909 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:44,909 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-16 18:01:44,909 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-16 18:01:44,909 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-16 18:01:44,909 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-16 18:01:44,910 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-16 18:01:44,910 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-16 18:01:44,910 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676570504910,5,FailOnTimeoutGroup] 2023-02-16 18:01:44,910 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676570504910,5,FailOnTimeoutGroup] 2023-02-16 18:01:44,910 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:44,910 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-16 18:01:44,910 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:44,910 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 18:01:44,910 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:44,918 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 18:01:44,919 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 18:01:44,919 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c 2023-02-16 18:01:44,926 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:44,927 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 18:01:44,928 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/hbase/meta/1588230740/info 2023-02-16 18:01:44,928 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 18:01:44,929 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:44,929 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 18:01:44,930 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/hbase/meta/1588230740/rep_barrier 2023-02-16 18:01:44,930 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 18:01:44,930 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:44,930 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 18:01:44,931 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/hbase/meta/1588230740/table 2023-02-16 18:01:44,931 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 18:01:44,932 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:44,932 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/hbase/meta/1588230740 2023-02-16 18:01:44,932 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/hbase/meta/1588230740 2023-02-16 18:01:44,933 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 18:01:44,934 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 18:01:44,936 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:44,936 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62525849, jitterRate=-0.06829224526882172}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 18:01:44,936 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 18:01:44,936 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 18:01:44,936 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 18:01:44,936 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 18:01:44,936 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 18:01:44,936 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 18:01:44,936 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 18:01:44,936 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 18:01:44,937 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 18:01:44,937 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-16 18:01:44,937 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-16 18:01:44,939 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-16 18:01:44,940 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-16 18:01:44,982 INFO [RS:0;jenkins-hbase4:33823] regionserver.HRegionServer(952): ClusterId : 7844244b-5b13-4ca7-b3df-fdf049b4716e 2023-02-16 18:01:44,982 INFO [RS:1;jenkins-hbase4:39705] regionserver.HRegionServer(952): ClusterId : 7844244b-5b13-4ca7-b3df-fdf049b4716e 2023-02-16 18:01:44,982 DEBUG [RS:0;jenkins-hbase4:33823] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 18:01:44,982 DEBUG [RS:1;jenkins-hbase4:39705] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 18:01:44,984 DEBUG [RS:1;jenkins-hbase4:39705] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 18:01:44,984 DEBUG [RS:1;jenkins-hbase4:39705] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 18:01:44,984 DEBUG [RS:0;jenkins-hbase4:33823] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 18:01:44,984 DEBUG [RS:0;jenkins-hbase4:33823] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 18:01:44,986 DEBUG [RS:1;jenkins-hbase4:39705] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 18:01:44,988 DEBUG [RS:1;jenkins-hbase4:39705] zookeeper.ReadOnlyZKClient(139): Connect 0x48bfd6d5 to 127.0.0.1:50386 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 18:01:44,988 DEBUG [RS:0;jenkins-hbase4:33823] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 18:01:44,993 DEBUG [RS:0;jenkins-hbase4:33823] zookeeper.ReadOnlyZKClient(139): Connect 0x30ef7f53 to 127.0.0.1:50386 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 18:01:45,001 DEBUG [RS:1;jenkins-hbase4:39705] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@467821b2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 18:01:45,001 DEBUG [RS:0;jenkins-hbase4:33823] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e28873e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 18:01:45,001 DEBUG [RS:1;jenkins-hbase4:39705] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4247bda5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 18:01:45,001 DEBUG [RS:0;jenkins-hbase4:33823] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a171423, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 18:01:45,009 DEBUG [RS:0;jenkins-hbase4:33823] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:33823 2023-02-16 18:01:45,009 INFO [RS:0;jenkins-hbase4:33823] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 18:01:45,009 INFO [RS:0;jenkins-hbase4:33823] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 18:01:45,009 DEBUG [RS:0;jenkins-hbase4:33823] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 18:01:45,010 INFO [RS:0;jenkins-hbase4:33823] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45797,1676570504700 with isa=jenkins-hbase4.apache.org/172.31.14.131:33823, startcode=1676570504737 2023-02-16 18:01:45,010 DEBUG [RS:0;jenkins-hbase4:33823] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 18:01:45,011 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55839, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 18:01:45,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:45,013 DEBUG [RS:0;jenkins-hbase4:33823] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c 2023-02-16 18:01:45,013 DEBUG [RS:0;jenkins-hbase4:33823] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:37837 2023-02-16 18:01:45,013 DEBUG [RS:1;jenkins-hbase4:39705] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:39705 2023-02-16 18:01:45,013 DEBUG [RS:0;jenkins-hbase4:33823] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 18:01:45,013 INFO [RS:1;jenkins-hbase4:39705] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 18:01:45,014 INFO [RS:1;jenkins-hbase4:39705] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 18:01:45,014 DEBUG [RS:1;jenkins-hbase4:39705] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 18:01:45,015 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:45,015 INFO [RS:1;jenkins-hbase4:39705] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45797,1676570504700 with isa=jenkins-hbase4.apache.org/172.31.14.131:39705, startcode=1676570504765 2023-02-16 18:01:45,015 DEBUG [RS:1;jenkins-hbase4:39705] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 18:01:45,015 DEBUG [RS:0;jenkins-hbase4:33823] zookeeper.ZKUtil(162): regionserver:33823-0x1005e4b97b00001, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:45,016 WARN [RS:0;jenkins-hbase4:33823] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 18:01:45,016 INFO [RS:0;jenkins-hbase4:33823] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 18:01:45,016 DEBUG [RS:0;jenkins-hbase4:33823] regionserver.HRegionServer(1947): logDir=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/WALs/jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:45,016 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33823,1676570504737] 2023-02-16 18:01:45,018 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42941, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 18:01:45,019 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39705,1676570504765 2023-02-16 18:01:45,019 DEBUG [RS:1;jenkins-hbase4:39705] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c 2023-02-16 18:01:45,019 DEBUG [RS:1;jenkins-hbase4:39705] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:37837 2023-02-16 18:01:45,019 DEBUG [RS:1;jenkins-hbase4:39705] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 18:01:45,019 DEBUG [RS:0;jenkins-hbase4:33823] zookeeper.ZKUtil(162): regionserver:33823-0x1005e4b97b00001, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:45,024 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:33823-0x1005e4b97b00001, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:45,024 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:45,024 DEBUG [RS:1;jenkins-hbase4:39705] zookeeper.ZKUtil(162): regionserver:39705-0x1005e4b97b00002, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39705,1676570504765 2023-02-16 18:01:45,024 WARN [RS:1;jenkins-hbase4:39705] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 18:01:45,024 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39705,1676570504765] 2023-02-16 18:01:45,024 DEBUG [RS:0;jenkins-hbase4:33823] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 18:01:45,024 INFO [RS:1;jenkins-hbase4:39705] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 18:01:45,024 DEBUG [RS:1;jenkins-hbase4:39705] regionserver.HRegionServer(1947): logDir=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/WALs/jenkins-hbase4.apache.org,39705,1676570504765 2023-02-16 18:01:45,024 INFO [RS:0;jenkins-hbase4:33823] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 18:01:45,024 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:33823-0x1005e4b97b00001, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39705,1676570504765 2023-02-16 18:01:45,025 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:33823-0x1005e4b97b00001, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:45,028 INFO [RS:0;jenkins-hbase4:33823] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 18:01:45,029 INFO [RS:0;jenkins-hbase4:33823] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 18:01:45,029 INFO [RS:0;jenkins-hbase4:33823] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:45,029 INFO [RS:0;jenkins-hbase4:33823] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 18:01:45,030 DEBUG [RS:1;jenkins-hbase4:39705] zookeeper.ZKUtil(162): regionserver:39705-0x1005e4b97b00002, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39705,1676570504765 2023-02-16 18:01:45,030 DEBUG [RS:1;jenkins-hbase4:39705] zookeeper.ZKUtil(162): regionserver:39705-0x1005e4b97b00002, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:45,030 INFO [RS:0;jenkins-hbase4:33823] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:45,030 DEBUG [RS:0;jenkins-hbase4:33823] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:45,030 DEBUG [RS:0;jenkins-hbase4:33823] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:45,030 DEBUG [RS:0;jenkins-hbase4:33823] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:45,030 DEBUG [RS:0;jenkins-hbase4:33823] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:45,030 DEBUG [RS:0;jenkins-hbase4:33823] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:45,030 DEBUG [RS:0;jenkins-hbase4:33823] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 18:01:45,030 DEBUG [RS:0;jenkins-hbase4:33823] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:45,030 DEBUG [RS:0;jenkins-hbase4:33823] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:45,030 DEBUG [RS:0;jenkins-hbase4:33823] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:45,030 DEBUG [RS:0;jenkins-hbase4:33823] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:45,031 DEBUG [RS:1;jenkins-hbase4:39705] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 18:01:45,031 INFO [RS:1;jenkins-hbase4:39705] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 18:01:45,031 INFO [RS:0;jenkins-hbase4:33823] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:45,031 INFO [RS:0;jenkins-hbase4:33823] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:45,031 INFO [RS:0;jenkins-hbase4:33823] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:45,032 INFO [RS:1;jenkins-hbase4:39705] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 18:01:45,032 INFO [RS:1;jenkins-hbase4:39705] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 18:01:45,032 INFO [RS:1;jenkins-hbase4:39705] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:45,033 INFO [RS:1;jenkins-hbase4:39705] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 18:01:45,034 INFO [RS:1;jenkins-hbase4:39705] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:45,034 DEBUG [RS:1;jenkins-hbase4:39705] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:45,034 DEBUG [RS:1;jenkins-hbase4:39705] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:45,034 DEBUG [RS:1;jenkins-hbase4:39705] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:45,034 DEBUG [RS:1;jenkins-hbase4:39705] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:45,034 DEBUG [RS:1;jenkins-hbase4:39705] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:45,035 DEBUG [RS:1;jenkins-hbase4:39705] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 18:01:45,035 DEBUG [RS:1;jenkins-hbase4:39705] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:45,035 DEBUG [RS:1;jenkins-hbase4:39705] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:45,035 DEBUG [RS:1;jenkins-hbase4:39705] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:45,035 DEBUG [RS:1;jenkins-hbase4:39705] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:45,035 INFO [RS:1;jenkins-hbase4:39705] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:45,035 INFO [RS:1;jenkins-hbase4:39705] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:45,036 INFO [RS:1;jenkins-hbase4:39705] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:45,044 INFO [RS:0;jenkins-hbase4:33823] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 18:01:45,044 INFO [RS:0;jenkins-hbase4:33823] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33823,1676570504737-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:45,047 INFO [RS:1;jenkins-hbase4:39705] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 18:01:45,047 INFO [RS:1;jenkins-hbase4:39705] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39705,1676570504765-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:45,054 INFO [RS:0;jenkins-hbase4:33823] regionserver.Replication(203): jenkins-hbase4.apache.org,33823,1676570504737 started 2023-02-16 18:01:45,054 INFO [RS:0;jenkins-hbase4:33823] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,33823,1676570504737, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33823, sessionid=0x1005e4b97b00001 2023-02-16 18:01:45,054 DEBUG [RS:0;jenkins-hbase4:33823] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 18:01:45,054 DEBUG [RS:0;jenkins-hbase4:33823] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:45,054 DEBUG [RS:0;jenkins-hbase4:33823] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33823,1676570504737' 2023-02-16 18:01:45,054 DEBUG [RS:0;jenkins-hbase4:33823] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:45,054 DEBUG [RS:0;jenkins-hbase4:33823] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:45,055 DEBUG [RS:0;jenkins-hbase4:33823] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 18:01:45,055 DEBUG [RS:0;jenkins-hbase4:33823] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 18:01:45,055 DEBUG [RS:0;jenkins-hbase4:33823] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:45,055 DEBUG [RS:0;jenkins-hbase4:33823] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33823,1676570504737' 2023-02-16 18:01:45,055 DEBUG [RS:0;jenkins-hbase4:33823] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:45,055 DEBUG [RS:0;jenkins-hbase4:33823] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:45,055 DEBUG [RS:0;jenkins-hbase4:33823] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 18:01:45,055 INFO [RS:0;jenkins-hbase4:33823] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 18:01:45,055 INFO [RS:0;jenkins-hbase4:33823] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 18:01:45,057 INFO [RS:1;jenkins-hbase4:39705] regionserver.Replication(203): jenkins-hbase4.apache.org,39705,1676570504765 started 2023-02-16 18:01:45,057 INFO [RS:1;jenkins-hbase4:39705] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,39705,1676570504765, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39705, sessionid=0x1005e4b97b00002 2023-02-16 18:01:45,057 DEBUG [RS:1;jenkins-hbase4:39705] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 18:01:45,057 DEBUG [RS:1;jenkins-hbase4:39705] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39705,1676570504765 2023-02-16 18:01:45,057 DEBUG [RS:1;jenkins-hbase4:39705] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39705,1676570504765' 2023-02-16 18:01:45,057 DEBUG [RS:1;jenkins-hbase4:39705] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:45,058 DEBUG [RS:1;jenkins-hbase4:39705] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:45,058 DEBUG [RS:1;jenkins-hbase4:39705] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 18:01:45,058 DEBUG [RS:1;jenkins-hbase4:39705] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 18:01:45,058 DEBUG [RS:1;jenkins-hbase4:39705] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39705,1676570504765 2023-02-16 18:01:45,058 DEBUG [RS:1;jenkins-hbase4:39705] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39705,1676570504765' 2023-02-16 18:01:45,058 DEBUG [RS:1;jenkins-hbase4:39705] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:45,058 DEBUG [RS:1;jenkins-hbase4:39705] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:45,058 DEBUG [RS:1;jenkins-hbase4:39705] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 18:01:45,058 INFO [RS:1;jenkins-hbase4:39705] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 18:01:45,058 INFO [RS:1;jenkins-hbase4:39705] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 18:01:45,090 DEBUG [jenkins-hbase4:45797] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-16 18:01:45,090 DEBUG [jenkins-hbase4:45797] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 18:01:45,092 DEBUG [jenkins-hbase4:45797] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 18:01:45,092 DEBUG [jenkins-hbase4:45797] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 18:01:45,092 DEBUG [jenkins-hbase4:45797] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 18:01:45,092 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39705,1676570504765, state=OPENING 2023-02-16 18:01:45,093 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-16 18:01:45,094 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:45,095 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 18:01:45,097 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39705,1676570504765}] 2023-02-16 18:01:45,251 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39705,1676570504765 2023-02-16 18:01:45,251 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 18:01:45,252 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55446, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 18:01:45,256 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-16 18:01:45,256 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 18:01:45,258 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39705%2C1676570504765.meta, suffix=.meta, logDir=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/WALs/jenkins-hbase4.apache.org,39705,1676570504765, archiveDir=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/oldWALs, maxLogs=32 2023-02-16 18:01:45,271 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33869,DS-ad42dffb-7860-48a6-93ba-cf0d0a06e556,DISK] 2023-02-16 18:01:45,271 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34495,DS-01a84b9e-683a-418b-924f-376c5b3e1b87,DISK] 2023-02-16 18:01:45,272 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/WALs/jenkins-hbase4.apache.org,39705,1676570504765/jenkins-hbase4.apache.org%2C39705%2C1676570504765.meta.1676570505258.meta 2023-02-16 18:01:45,273 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33869,DS-ad42dffb-7860-48a6-93ba-cf0d0a06e556,DISK], DatanodeInfoWithStorage[127.0.0.1:34495,DS-01a84b9e-683a-418b-924f-376c5b3e1b87,DISK]] 2023-02-16 18:01:45,273 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-16 18:01:45,273 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-16 18:01:45,273 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-16 18:01:45,273 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-16 18:01:45,273 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-16 18:01:45,273 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:45,273 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-16 18:01:45,273 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-16 18:01:45,275 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 18:01:45,276 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/hbase/meta/1588230740/info 2023-02-16 18:01:45,276 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/hbase/meta/1588230740/info 2023-02-16 18:01:45,276 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 18:01:45,277 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:45,277 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 18:01:45,280 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/hbase/meta/1588230740/rep_barrier 2023-02-16 18:01:45,280 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/hbase/meta/1588230740/rep_barrier 2023-02-16 18:01:45,280 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 18:01:45,281 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:45,281 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 18:01:45,282 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/hbase/meta/1588230740/table 2023-02-16 18:01:45,282 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/hbase/meta/1588230740/table 2023-02-16 18:01:45,282 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 18:01:45,283 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:45,284 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/hbase/meta/1588230740 2023-02-16 18:01:45,285 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/hbase/meta/1588230740 2023-02-16 18:01:45,286 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 18:01:45,287 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 18:01:45,288 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75343645, jitterRate=0.122707799077034}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 18:01:45,288 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 18:01:45,289 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676570505251 2023-02-16 18:01:45,293 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-16 18:01:45,293 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-16 18:01:45,294 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39705,1676570504765, state=OPEN 2023-02-16 18:01:45,295 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-16 18:01:45,295 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 18:01:45,297 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-16 18:01:45,298 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39705,1676570504765 in 200 msec 2023-02-16 18:01:45,301 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-16 18:01:45,301 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 361 msec 2023-02-16 18:01:45,302 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 397 msec 2023-02-16 18:01:45,303 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676570505302, completionTime=-1 2023-02-16 18:01:45,303 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-16 18:01:45,303 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-16 18:01:45,305 DEBUG [hconnection-0xeac26a6-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 18:01:45,307 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55458, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 18:01:45,308 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-16 18:01:45,308 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676570565308 2023-02-16 18:01:45,308 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676570625308 2023-02-16 18:01:45,309 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-16 18:01:45,317 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45797,1676570504700-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:45,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45797,1676570504700-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:45,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45797,1676570504700-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:45,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:45797, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:45,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:45,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-16 18:01:45,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 18:01:45,320 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-16 18:01:45,321 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-16 18:01:45,322 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 18:01:45,322 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 18:01:45,324 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/.tmp/data/hbase/namespace/56285a232411105e5a4f967d730fc6b3 2023-02-16 18:01:45,325 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/.tmp/data/hbase/namespace/56285a232411105e5a4f967d730fc6b3 empty. 2023-02-16 18:01:45,325 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/.tmp/data/hbase/namespace/56285a232411105e5a4f967d730fc6b3 2023-02-16 18:01:45,325 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-16 18:01:45,336 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-16 18:01:45,337 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 56285a232411105e5a4f967d730fc6b3, NAME => 'hbase:namespace,,1676570505319.56285a232411105e5a4f967d730fc6b3.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/.tmp 2023-02-16 18:01:45,343 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676570505319.56285a232411105e5a4f967d730fc6b3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:45,344 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 56285a232411105e5a4f967d730fc6b3, disabling compactions & flushes 2023-02-16 18:01:45,344 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676570505319.56285a232411105e5a4f967d730fc6b3. 2023-02-16 18:01:45,344 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676570505319.56285a232411105e5a4f967d730fc6b3. 2023-02-16 18:01:45,344 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676570505319.56285a232411105e5a4f967d730fc6b3. after waiting 0 ms 2023-02-16 18:01:45,344 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676570505319.56285a232411105e5a4f967d730fc6b3. 2023-02-16 18:01:45,344 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676570505319.56285a232411105e5a4f967d730fc6b3. 2023-02-16 18:01:45,344 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 56285a232411105e5a4f967d730fc6b3: 2023-02-16 18:01:45,346 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 18:01:45,347 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676570505319.56285a232411105e5a4f967d730fc6b3.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676570505347"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570505347"}]},"ts":"1676570505347"} 2023-02-16 18:01:45,350 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 18:01:45,351 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 18:01:45,351 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676570505351"}]},"ts":"1676570505351"} 2023-02-16 18:01:45,352 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-16 18:01:45,355 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 18:01:45,356 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 18:01:45,356 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 18:01:45,356 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 18:01:45,356 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=56285a232411105e5a4f967d730fc6b3, ASSIGN}] 2023-02-16 18:01:45,359 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=56285a232411105e5a4f967d730fc6b3, ASSIGN 2023-02-16 18:01:45,359 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=56285a232411105e5a4f967d730fc6b3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39705,1676570504765; forceNewPlan=false, retain=false 2023-02-16 18:01:45,510 INFO [jenkins-hbase4:45797] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 18:01:45,510 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=56285a232411105e5a4f967d730fc6b3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39705,1676570504765 2023-02-16 18:01:45,510 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676570505319.56285a232411105e5a4f967d730fc6b3.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676570505510"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570505510"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570505510"}]},"ts":"1676570505510"} 2023-02-16 18:01:45,512 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 56285a232411105e5a4f967d730fc6b3, server=jenkins-hbase4.apache.org,39705,1676570504765}] 2023-02-16 18:01:45,666 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676570505319.56285a232411105e5a4f967d730fc6b3. 2023-02-16 18:01:45,667 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39705%2C1676570504765, suffix=, logDir=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/WALs/jenkins-hbase4.apache.org,39705,1676570504765, archiveDir=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/oldWALs, maxLogs=32 2023-02-16 18:01:45,679 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33869,DS-ad42dffb-7860-48a6-93ba-cf0d0a06e556,DISK] 2023-02-16 18:01:45,679 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34495,DS-01a84b9e-683a-418b-924f-376c5b3e1b87,DISK] 2023-02-16 18:01:45,681 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/WALs/jenkins-hbase4.apache.org,39705,1676570504765/jenkins-hbase4.apache.org%2C39705%2C1676570504765.1676570505668 2023-02-16 18:01:45,681 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33869,DS-ad42dffb-7860-48a6-93ba-cf0d0a06e556,DISK], DatanodeInfoWithStorage[127.0.0.1:34495,DS-01a84b9e-683a-418b-924f-376c5b3e1b87,DISK]] 2023-02-16 18:01:45,681 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 56285a232411105e5a4f967d730fc6b3, NAME => 'hbase:namespace,,1676570505319.56285a232411105e5a4f967d730fc6b3.', STARTKEY => '', ENDKEY => ''} 2023-02-16 18:01:45,681 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 56285a232411105e5a4f967d730fc6b3 2023-02-16 18:01:45,681 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676570505319.56285a232411105e5a4f967d730fc6b3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:45,682 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 56285a232411105e5a4f967d730fc6b3 2023-02-16 18:01:45,682 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 56285a232411105e5a4f967d730fc6b3 2023-02-16 18:01:45,682 INFO [StoreOpener-56285a232411105e5a4f967d730fc6b3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 56285a232411105e5a4f967d730fc6b3 2023-02-16 18:01:45,684 DEBUG [StoreOpener-56285a232411105e5a4f967d730fc6b3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/hbase/namespace/56285a232411105e5a4f967d730fc6b3/info 2023-02-16 18:01:45,684 DEBUG [StoreOpener-56285a232411105e5a4f967d730fc6b3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/hbase/namespace/56285a232411105e5a4f967d730fc6b3/info 2023-02-16 18:01:45,684 INFO [StoreOpener-56285a232411105e5a4f967d730fc6b3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 56285a232411105e5a4f967d730fc6b3 columnFamilyName info 2023-02-16 18:01:45,684 INFO [StoreOpener-56285a232411105e5a4f967d730fc6b3-1] regionserver.HStore(310): Store=56285a232411105e5a4f967d730fc6b3/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:45,685 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/hbase/namespace/56285a232411105e5a4f967d730fc6b3 2023-02-16 18:01:45,685 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/hbase/namespace/56285a232411105e5a4f967d730fc6b3 2023-02-16 18:01:45,687 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 56285a232411105e5a4f967d730fc6b3 2023-02-16 18:01:45,688 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/hbase/namespace/56285a232411105e5a4f967d730fc6b3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:45,689 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 56285a232411105e5a4f967d730fc6b3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65844459, jitterRate=-0.018841102719306946}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 18:01:45,689 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 56285a232411105e5a4f967d730fc6b3: 2023-02-16 18:01:45,689 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676570505319.56285a232411105e5a4f967d730fc6b3., pid=6, masterSystemTime=1676570505663 2023-02-16 18:01:45,691 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676570505319.56285a232411105e5a4f967d730fc6b3. 2023-02-16 18:01:45,692 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676570505319.56285a232411105e5a4f967d730fc6b3. 2023-02-16 18:01:45,692 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=56285a232411105e5a4f967d730fc6b3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39705,1676570504765 2023-02-16 18:01:45,692 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676570505319.56285a232411105e5a4f967d730fc6b3.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676570505692"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676570505692"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676570505692"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676570505692"}]},"ts":"1676570505692"} 2023-02-16 18:01:45,694 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-16 18:01:45,694 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 56285a232411105e5a4f967d730fc6b3, server=jenkins-hbase4.apache.org,39705,1676570504765 in 181 msec 2023-02-16 18:01:45,696 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-16 18:01:45,696 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=56285a232411105e5a4f967d730fc6b3, ASSIGN in 338 msec 2023-02-16 18:01:45,696 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 18:01:45,696 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676570505696"}]},"ts":"1676570505696"} 2023-02-16 18:01:45,697 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-16 18:01:45,704 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 18:01:45,705 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 385 msec 2023-02-16 18:01:45,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-16 18:01:45,722 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-16 18:01:45,722 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:45,725 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-16 18:01:45,732 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 18:01:45,734 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 8 msec 2023-02-16 18:01:45,736 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-16 18:01:45,742 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 18:01:45,745 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-16 18:01:45,750 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-16 18:01:45,752 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-16 18:01:45,752 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.960sec 2023-02-16 18:01:45,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-16 18:01:45,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-16 18:01:45,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-16 18:01:45,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45797,1676570504700-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-16 18:01:45,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45797,1676570504700-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-16 18:01:45,754 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-16 18:01:45,783 DEBUG [Listener at localhost/34323] zookeeper.ReadOnlyZKClient(139): Connect 0x0a3982d8 to 127.0.0.1:50386 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 18:01:45,791 DEBUG [Listener at localhost/34323] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@302d9350, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 18:01:45,792 DEBUG [hconnection-0x59909241-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 18:01:45,794 INFO [RS-EventLoopGroup-17-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55460, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 18:01:45,795 INFO [Listener at localhost/34323] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,45797,1676570504700 2023-02-16 18:01:45,795 DEBUG [Listener at localhost/34323] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-16 18:01:45,798 DEBUG [Listener at localhost/34323] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-16 18:01:45,799 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38174, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-16 18:01:45,800 INFO [Listener at localhost/34323] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-16 18:01:45,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-16 18:01:45,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-16 18:01:45,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 96 connection: 172.31.14.131:38174 deadline: 1676570565800, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-16 18:01:45,801 INFO [Listener at localhost/34323] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-16 18:01:45,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 18:01:45,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-16 18:01:45,807 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 18:01:45,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-16 18:01:45,807 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 18:01:45,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 18:01:45,809 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/.tmp/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4 2023-02-16 18:01:45,809 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/.tmp/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4 empty. 2023-02-16 18:01:45,810 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/.tmp/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4 2023-02-16 18:01:45,810 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-16 18:01:45,820 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-16 18:01:45,821 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => aa306980a89e729430649cac92fad9b4, NAME => 'testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/.tmp 2023-02-16 18:01:45,851 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:45,851 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing aa306980a89e729430649cac92fad9b4, disabling compactions & flushes 2023-02-16 18:01:45,851 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4. 2023-02-16 18:01:45,851 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4. 2023-02-16 18:01:45,852 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4. after waiting 0 ms 2023-02-16 18:01:45,852 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4. 2023-02-16 18:01:45,852 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4. 2023-02-16 18:01:45,852 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for aa306980a89e729430649cac92fad9b4: 2023-02-16 18:01:45,854 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 18:01:45,855 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676570505855"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570505855"}]},"ts":"1676570505855"} 2023-02-16 18:01:45,857 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 18:01:45,858 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 18:01:45,858 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676570505858"}]},"ts":"1676570505858"} 2023-02-16 18:01:45,859 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-16 18:01:45,863 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 18:01:45,865 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 18:01:45,865 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 18:01:45,865 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 18:01:45,865 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=aa306980a89e729430649cac92fad9b4, ASSIGN}] 2023-02-16 18:01:45,867 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=aa306980a89e729430649cac92fad9b4, ASSIGN 2023-02-16 18:01:45,868 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=aa306980a89e729430649cac92fad9b4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33823,1676570504737; forceNewPlan=false, retain=false 2023-02-16 18:01:45,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 18:01:46,018 INFO [jenkins-hbase4:45797] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 18:01:46,019 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=aa306980a89e729430649cac92fad9b4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:46,019 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676570506018"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570506018"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570506018"}]},"ts":"1676570506018"} 2023-02-16 18:01:46,020 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure aa306980a89e729430649cac92fad9b4, server=jenkins-hbase4.apache.org,33823,1676570504737}] 2023-02-16 18:01:46,057 INFO [RS:0;jenkins-hbase4:33823] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33823%2C1676570504737, suffix=, logDir=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/WALs/jenkins-hbase4.apache.org,33823,1676570504737, archiveDir=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/oldWALs, maxLogs=32 2023-02-16 18:01:46,072 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33869,DS-ad42dffb-7860-48a6-93ba-cf0d0a06e556,DISK] 2023-02-16 18:01:46,072 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34495,DS-01a84b9e-683a-418b-924f-376c5b3e1b87,DISK] 2023-02-16 18:01:46,073 INFO [RS:0;jenkins-hbase4:33823] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/WALs/jenkins-hbase4.apache.org,33823,1676570504737/jenkins-hbase4.apache.org%2C33823%2C1676570504737.1676570506057 2023-02-16 18:01:46,073 DEBUG [RS:0;jenkins-hbase4:33823] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34495,DS-01a84b9e-683a-418b-924f-376c5b3e1b87,DISK], DatanodeInfoWithStorage[127.0.0.1:33869,DS-ad42dffb-7860-48a6-93ba-cf0d0a06e556,DISK]] 2023-02-16 18:01:46,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 18:01:46,174 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:46,174 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 18:01:46,175 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59402, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 18:01:46,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4. 2023-02-16 18:01:46,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => aa306980a89e729430649cac92fad9b4, NAME => 'testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4.', STARTKEY => '', ENDKEY => ''} 2023-02-16 18:01:46,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion aa306980a89e729430649cac92fad9b4 2023-02-16 18:01:46,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:46,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for aa306980a89e729430649cac92fad9b4 2023-02-16 18:01:46,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for aa306980a89e729430649cac92fad9b4 2023-02-16 18:01:46,180 INFO [StoreOpener-aa306980a89e729430649cac92fad9b4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region aa306980a89e729430649cac92fad9b4 2023-02-16 18:01:46,181 DEBUG [StoreOpener-aa306980a89e729430649cac92fad9b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/f1 2023-02-16 18:01:46,181 DEBUG [StoreOpener-aa306980a89e729430649cac92fad9b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/f1 2023-02-16 18:01:46,182 INFO [StoreOpener-aa306980a89e729430649cac92fad9b4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aa306980a89e729430649cac92fad9b4 columnFamilyName f1 2023-02-16 18:01:46,182 INFO [StoreOpener-aa306980a89e729430649cac92fad9b4-1] regionserver.HStore(310): Store=aa306980a89e729430649cac92fad9b4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:46,182 INFO [StoreOpener-aa306980a89e729430649cac92fad9b4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region aa306980a89e729430649cac92fad9b4 2023-02-16 18:01:46,184 DEBUG [StoreOpener-aa306980a89e729430649cac92fad9b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/f2 2023-02-16 18:01:46,184 DEBUG [StoreOpener-aa306980a89e729430649cac92fad9b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/f2 2023-02-16 18:01:46,184 INFO [StoreOpener-aa306980a89e729430649cac92fad9b4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aa306980a89e729430649cac92fad9b4 columnFamilyName f2 2023-02-16 18:01:46,185 INFO [StoreOpener-aa306980a89e729430649cac92fad9b4-1] regionserver.HStore(310): Store=aa306980a89e729430649cac92fad9b4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:46,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4 2023-02-16 18:01:46,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4 2023-02-16 18:01:46,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:46,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for aa306980a89e729430649cac92fad9b4 2023-02-16 18:01:46,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:46,192 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened aa306980a89e729430649cac92fad9b4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65695620, jitterRate=-0.021058976650238037}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:46,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for aa306980a89e729430649cac92fad9b4: 2023-02-16 18:01:46,193 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4., pid=12, masterSystemTime=1676570506174 2023-02-16 18:01:46,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4. 2023-02-16 18:01:46,198 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4. 2023-02-16 18:01:46,198 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=aa306980a89e729430649cac92fad9b4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:46,198 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676570506198"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676570506198"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676570506198"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676570506198"}]},"ts":"1676570506198"} 2023-02-16 18:01:46,201 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-16 18:01:46,201 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure aa306980a89e729430649cac92fad9b4, server=jenkins-hbase4.apache.org,33823,1676570504737 in 179 msec 2023-02-16 18:01:46,203 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-16 18:01:46,203 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=aa306980a89e729430649cac92fad9b4, ASSIGN in 336 msec 2023-02-16 18:01:46,205 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 18:01:46,205 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676570506205"}]},"ts":"1676570506205"} 2023-02-16 18:01:46,206 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-16 18:01:46,209 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 18:01:46,210 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 404 msec 2023-02-16 18:01:46,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 18:01:46,412 INFO [Listener at localhost/34323] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-16 18:01:46,412 DEBUG [Listener at localhost/34323] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-16 18:01:46,413 INFO [Listener at localhost/34323] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 18:01:46,414 INFO [Listener at localhost/34323] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-16 18:01:46,415 INFO [Listener at localhost/34323] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 18:01:46,415 INFO [Listener at localhost/34323] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-16 18:01:46,415 INFO [Listener at localhost/34323] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-16 18:01:46,428 DEBUG [hconnection-0x59909241-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 18:01:46,441 INFO [RS-EventLoopGroup-16-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59416, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 18:01:46,521 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33823] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4. 2023-02-16 18:01:46,621 INFO [Listener at localhost/34323] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-16 18:01:46,621 INFO [Listener at localhost/34323] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-16 18:01:46,622 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-16 18:01:46,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676570506622 (current time:1676570506622). 2023-02-16 18:01:46,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-16 18:01:46,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] zookeeper.ReadOnlyZKClient(139): Connect 0x3a14fa2e to 127.0.0.1:50386 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 18:01:46,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e17fe9e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 18:01:46,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 18:01:46,628 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55462, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 18:01:46,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a14fa2e to 127.0.0.1:50386 2023-02-16 18:01:46,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:46,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-16 18:01:46,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-16 18:01:46,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-16 18:01:46,634 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-16 18:01:46,635 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676571106635 2023-02-16 18:01:46,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-16 18:01:46,635 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,636 DEBUG [Listener at localhost/34323] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-16 18:01:46,636 DEBUG [Listener at localhost/34323] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-16 18:01:46,637 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-16 18:01:46,637 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-16 18:01:46,638 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 4 msec 2023-02-16 18:01:46,639 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-16 18:01:46,639 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1676571106639 2023-02-16 18:01:46,646 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,646 INFO [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-16 18:01:46,646 DEBUG [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 18:01:46,646 DEBUG [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-16 18:01:46,647 DEBUG [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-16 18:01:46,647 DEBUG [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,647 DEBUG [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,649 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x1005e4b97b00002, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 18:01:46,649 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:33823-0x1005e4b97b00001, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 18:01:46,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 18:01:46,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 18:01:46,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:46,649 DEBUG [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:46,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:46,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,650 DEBUG [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:46,650 DEBUG [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 18:01:46,650 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33823-0x1005e4b97b00001, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,650 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39705-0x1005e4b97b00002, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-16 18:01:46,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-16 18:01:46,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,651 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-16 18:01:46,651 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-16 18:01:46,651 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,651 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,651 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1676570504765' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-16 18:01:46,651 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1676570504765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 18:01:46,652 DEBUG [member: 'jenkins-hbase4.apache.org,33823,1676570504737' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-16 18:01:46,652 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1676570504765' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-16 18:01:46,652 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1676570504765' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-16 18:01:46,652 DEBUG [member: 'jenkins-hbase4.apache.org,33823,1676570504737' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 18:01:46,652 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1676570504765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39705,1676570504765' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-16 18:01:46,652 DEBUG [member: 'jenkins-hbase4.apache.org,33823,1676570504737' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-16 18:01:46,652 DEBUG [member: 'jenkins-hbase4.apache.org,33823,1676570504737' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-16 18:01:46,652 DEBUG [member: 'jenkins-hbase4.apache.org,33823,1676570504737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33823,1676570504737' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-16 18:01:46,653 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1676570504765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,654 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:46,654 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1676570504765' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39705-0x1005e4b97b00002, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:46,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:46,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 18:01:46,654 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1676570504765' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 18:01:46,654 DEBUG [member: 'jenkins-hbase4.apache.org,33823,1676570504737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:46,655 DEBUG [member: 'jenkins-hbase4.apache.org,33823,1676570504737' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33823-0x1005e4b97b00001, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,655 DEBUG [member: 'jenkins-hbase4.apache.org,33823,1676570504737' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 18:01:46,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:46,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1676570504765 2023-02-16 18:01:46,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:46,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:46,656 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33823,1676570504737' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-16 18:01:46,656 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64952ae3[Count = 0] remaining members to acquire global barrier 2023-02-16 18:01:46,656 DEBUG [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-16 18:01:46,656 DEBUG [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,657 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x1005e4b97b00002, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,657 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:33823-0x1005e4b97b00001, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,657 DEBUG [member: 'jenkins-hbase4.apache.org,33823,1676570504737' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-16 18:01:46,657 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1676570504765' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-16 18:01:46,657 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1676570504765' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-16 18:01:46,657 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1676570504765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,39705,1676570504765' in zk 2023-02-16 18:01:46,657 DEBUG [member: 'jenkins-hbase4.apache.org,33823,1676570504737' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-16 18:01:46,657 DEBUG [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:46,657 DEBUG [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 18:01:46,657 DEBUG [member: 'jenkins-hbase4.apache.org,33823,1676570504737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 18:01:46,657 DEBUG [rs(jenkins-hbase4.apache.org,33823,1676570504737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4. 2023-02-16 18:01:46,658 DEBUG [rs(jenkins-hbase4.apache.org,33823,1676570504737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4. started... 2023-02-16 18:01:46,658 INFO [rs(jenkins-hbase4.apache.org,33823,1676570504737)-snapshot-pool-0] regionserver.HRegion(2744): Flushing aa306980a89e729430649cac92fad9b4 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-16 18:01:46,660 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1676570504765' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-16 18:01:46,660 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1676570504765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:46,660 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1676570504765' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-16 18:01:46,670 INFO [rs(jenkins-hbase4.apache.org,33823,1676570504737)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/.tmp/f1/1ae58be7b09945c380ac7c1ea846ba22 2023-02-16 18:01:46,685 INFO [rs(jenkins-hbase4.apache.org,33823,1676570504737)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/.tmp/f2/628f3354d04043a0b12ce330cf036e95 2023-02-16 18:01:46,689 DEBUG [rs(jenkins-hbase4.apache.org,33823,1676570504737)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/.tmp/f1/1ae58be7b09945c380ac7c1ea846ba22 as hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/f1/1ae58be7b09945c380ac7c1ea846ba22 2023-02-16 18:01:46,693 INFO [rs(jenkins-hbase4.apache.org,33823,1676570504737)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/f1/1ae58be7b09945c380ac7c1ea846ba22, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-16 18:01:46,693 DEBUG [rs(jenkins-hbase4.apache.org,33823,1676570504737)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/.tmp/f2/628f3354d04043a0b12ce330cf036e95 as hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/f2/628f3354d04043a0b12ce330cf036e95 2023-02-16 18:01:46,697 INFO [rs(jenkins-hbase4.apache.org,33823,1676570504737)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/f2/628f3354d04043a0b12ce330cf036e95, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-16 18:01:46,697 INFO [rs(jenkins-hbase4.apache.org,33823,1676570504737)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for aa306980a89e729430649cac92fad9b4 in 39ms, sequenceid=5, compaction requested=false 2023-02-16 18:01:46,697 DEBUG [rs(jenkins-hbase4.apache.org,33823,1676570504737)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-16 18:01:46,698 DEBUG [rs(jenkins-hbase4.apache.org,33823,1676570504737)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for aa306980a89e729430649cac92fad9b4: 2023-02-16 18:01:46,698 DEBUG [rs(jenkins-hbase4.apache.org,33823,1676570504737)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,698 DEBUG [rs(jenkins-hbase4.apache.org,33823,1676570504737)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 18:01:46,698 DEBUG [rs(jenkins-hbase4.apache.org,33823,1676570504737)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/f1/1ae58be7b09945c380ac7c1ea846ba22] hfiles 2023-02-16 18:01:46,698 DEBUG [rs(jenkins-hbase4.apache.org,33823,1676570504737)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/f1/1ae58be7b09945c380ac7c1ea846ba22 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,698 DEBUG [rs(jenkins-hbase4.apache.org,33823,1676570504737)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/f2/628f3354d04043a0b12ce330cf036e95] hfiles 2023-02-16 18:01:46,698 DEBUG [rs(jenkins-hbase4.apache.org,33823,1676570504737)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/f2/628f3354d04043a0b12ce330cf036e95 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,704 DEBUG [rs(jenkins-hbase4.apache.org,33823,1676570504737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4. completed. 2023-02-16 18:01:46,704 DEBUG [rs(jenkins-hbase4.apache.org,33823,1676570504737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4. 2023-02-16 18:01:46,704 DEBUG [member: 'jenkins-hbase4.apache.org,33823,1676570504737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-16 18:01:46,705 DEBUG [member: 'jenkins-hbase4.apache.org,33823,1676570504737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-16 18:01:46,705 DEBUG [member: 'jenkins-hbase4.apache.org,33823,1676570504737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:46,705 DEBUG [member: 'jenkins-hbase4.apache.org,33823,1676570504737' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-16 18:01:46,705 DEBUG [member: 'jenkins-hbase4.apache.org,33823,1676570504737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,33823,1676570504737' in zk 2023-02-16 18:01:46,706 DEBUG [member: 'jenkins-hbase4.apache.org,33823,1676570504737' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-16 18:01:46,706 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:46,706 DEBUG [member: 'jenkins-hbase4.apache.org,33823,1676570504737' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:46,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:46,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:46,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 18:01:46,706 DEBUG [member: 'jenkins-hbase4.apache.org,33823,1676570504737' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-16 18:01:46,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:46,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:46,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1676570504765 2023-02-16 18:01:46,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:46,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:46,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1676570504765 2023-02-16 18:01:46,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:46,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,33823,1676570504737': 2023-02-16 18:01:46,709 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33823,1676570504737' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-16 18:01:46,709 INFO [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-16 18:01:46,709 DEBUG [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 18:01:46,709 DEBUG [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 18:01:46,709 DEBUG [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,709 INFO [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-16 18:01:46,710 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,710 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:33823-0x1005e4b97b00001, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,710 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x1005e4b97b00002, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:46,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 18:01:46,710 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:33823-0x1005e4b97b00001, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 18:01:46,711 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x1005e4b97b00002, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 18:01:46,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 18:01:46,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:46,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 18:01:46,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:46,711 DEBUG [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,39705,1676570504765 2023-02-16 18:01:46,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:46,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,711 DEBUG [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:46,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:46,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1676570504765 2023-02-16 18:01:46,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:46,713 DEBUG [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,39705,1676570504765 2023-02-16 18:01:46,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:46,713 DEBUG [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:46,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1676570504765 2023-02-16 18:01:46,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:46,719 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:46,719 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:33823-0x1005e4b97b00001, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 18:01:46,719 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,719 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:33823-0x1005e4b97b00001, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 18:01:46,719 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x1005e4b97b00002, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 18:01:46,719 DEBUG [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:46,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 18:01:46,719 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x1005e4b97b00002, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 18:01:46,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:46,719 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,719 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,39705,1676570504765 2023-02-16 18:01:46,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 18:01:46,719 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,719 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,719 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:46,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:46,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 18:01:46,720 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:46,720 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,39705,1676570504765 2023-02-16 18:01:46,720 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,720 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 18:01:46,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:46,720 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,734 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,737 DEBUG [Listener at localhost/34323] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 18:01:46,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-16 18:01:46,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-16 18:01:46,739 DEBUG [Listener at localhost/34323] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-16 18:01:46,750 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-16 18:01:46,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,750 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:46,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1676570506635Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1676570506719 (+84 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1676570506720 (+1 ms)Writing data manifest for testWithMockedMapReduceSingleRegion at 1676570506722 (+2 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1676570506727 (+5 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1676570506750 (+23 ms) 2023-02-16 18:01:46,752 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-16 18:01:46,753 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 116 msec 2023-02-16 18:01:46,939 DEBUG [Listener at localhost/34323] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 18:01:46,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-16 18:01:46,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-16 18:01:46,940 INFO [Listener at localhost/34323] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-16 18:01:46,944 INFO [Listener at localhost/34323] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-16 18:01:46,949 INFO [Listener at localhost/34323] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-16 18:01:46,979 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33823] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4. 2023-02-16 18:01:47,063 INFO [Listener at localhost/34323] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-16 18:01:47,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-16 18:01:47,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,069 INFO [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-16 18:01:47,069 DEBUG [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 18:01:47,070 DEBUG [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-16 18:01:47,070 DEBUG [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-16 18:01:47,071 DEBUG [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,071 DEBUG [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,072 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x1005e4b97b00002, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 18:01:47,072 DEBUG [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:47,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 18:01:47,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:47,072 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:33823-0x1005e4b97b00001, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 18:01:47,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 18:01:47,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:47,072 DEBUG [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:47,072 DEBUG [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 18:01:47,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,073 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39705-0x1005e4b97b00002, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,073 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33823-0x1005e4b97b00001, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 18:01:47,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 18:01:47,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,073 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,073 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,073 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,073 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,074 DEBUG [member: 'jenkins-hbase4.apache.org,33823,1676570504737' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-16 18:01:47,074 DEBUG [member: 'jenkins-hbase4.apache.org,33823,1676570504737' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 18:01:47,074 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1676570504765' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-16 18:01:47,074 DEBUG [member: 'jenkins-hbase4.apache.org,33823,1676570504737' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-16 18:01:47,074 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1676570504765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 18:01:47,075 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1676570504765' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-16 18:01:47,075 DEBUG [member: 'jenkins-hbase4.apache.org,33823,1676570504737' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-16 18:01:47,075 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1676570504765' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-16 18:01:47,075 DEBUG [rs(jenkins-hbase4.apache.org,33823,1676570504737)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4. 2023-02-16 18:01:47,075 DEBUG [rs(jenkins-hbase4.apache.org,33823,1676570504737)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4. started... 2023-02-16 18:01:47,075 DEBUG [member: 'jenkins-hbase4.apache.org,33823,1676570504737' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 18:01:47,075 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1676570504765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39705,1676570504765' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-16 18:01:47,075 INFO [rs(jenkins-hbase4.apache.org,33823,1676570504737)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing aa306980a89e729430649cac92fad9b4 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-16 18:01:47,077 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1676570504765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,077 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1676570504765' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39705-0x1005e4b97b00002, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,077 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1676570504765' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 18:01:47,089 INFO [rs(jenkins-hbase4.apache.org,33823,1676570504737)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/.tmp/f1/ba5184c6bf2f424d94b3ca35366ce757 2023-02-16 18:01:47,107 INFO [rs(jenkins-hbase4.apache.org,33823,1676570504737)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/.tmp/f2/bd52fad468884feeade9da86caa82570 2023-02-16 18:01:47,111 DEBUG [rs(jenkins-hbase4.apache.org,33823,1676570504737)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/.tmp/f1/ba5184c6bf2f424d94b3ca35366ce757 as hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/f1/ba5184c6bf2f424d94b3ca35366ce757 2023-02-16 18:01:47,115 INFO [rs(jenkins-hbase4.apache.org,33823,1676570504737)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/f1/ba5184c6bf2f424d94b3ca35366ce757, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-16 18:01:47,115 DEBUG [rs(jenkins-hbase4.apache.org,33823,1676570504737)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/.tmp/f2/bd52fad468884feeade9da86caa82570 as hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/f2/bd52fad468884feeade9da86caa82570 2023-02-16 18:01:47,118 INFO [rs(jenkins-hbase4.apache.org,33823,1676570504737)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/f2/bd52fad468884feeade9da86caa82570, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-16 18:01:47,119 INFO [rs(jenkins-hbase4.apache.org,33823,1676570504737)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for aa306980a89e729430649cac92fad9b4 in 44ms, sequenceid=9, compaction requested=false 2023-02-16 18:01:47,120 DEBUG [rs(jenkins-hbase4.apache.org,33823,1676570504737)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for aa306980a89e729430649cac92fad9b4: 2023-02-16 18:01:47,120 DEBUG [rs(jenkins-hbase4.apache.org,33823,1676570504737)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4. 2023-02-16 18:01:47,120 DEBUG [member: 'jenkins-hbase4.apache.org,33823,1676570504737' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-16 18:01:47,120 DEBUG [member: 'jenkins-hbase4.apache.org,33823,1676570504737' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-16 18:01:47,120 DEBUG [member: 'jenkins-hbase4.apache.org,33823,1676570504737' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:47,120 DEBUG [member: 'jenkins-hbase4.apache.org,33823,1676570504737' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-16 18:01:47,120 DEBUG [member: 'jenkins-hbase4.apache.org,33823,1676570504737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33823,1676570504737' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-16 18:01:47,122 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:47,122 DEBUG [member: 'jenkins-hbase4.apache.org,33823,1676570504737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:47,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:47,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 18:01:47,122 DEBUG [member: 'jenkins-hbase4.apache.org,33823,1676570504737' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33823-0x1005e4b97b00001, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,122 DEBUG [member: 'jenkins-hbase4.apache.org,33823,1676570504737' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 18:01:47,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:47,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:47,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1676570504765 2023-02-16 18:01:47,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:47,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:47,124 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33823,1676570504737' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-16 18:01:47,124 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@60aab2a9[Count = 0] remaining members to acquire global barrier 2023-02-16 18:01:47,124 DEBUG [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-16 18:01:47,124 DEBUG [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,126 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:33823-0x1005e4b97b00001, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,126 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x1005e4b97b00002, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,126 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1676570504765' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-16 18:01:47,126 DEBUG [member: 'jenkins-hbase4.apache.org,33823,1676570504737' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-16 18:01:47,126 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1676570504765' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-16 18:01:47,126 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1676570504765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,39705,1676570504765' in zk 2023-02-16 18:01:47,126 DEBUG [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:47,126 DEBUG [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 18:01:47,126 DEBUG [member: 'jenkins-hbase4.apache.org,33823,1676570504737' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-16 18:01:47,126 DEBUG [member: 'jenkins-hbase4.apache.org,33823,1676570504737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,33823,1676570504737' in zk 2023-02-16 18:01:47,128 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1676570504765' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-16 18:01:47,128 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1676570504765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:47,128 DEBUG [member: 'jenkins-hbase4.apache.org,39705,1676570504765' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-16 18:01:47,128 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:47,128 DEBUG [member: 'jenkins-hbase4.apache.org,33823,1676570504737' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-16 18:01:47,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:47,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:47,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 18:01:47,128 DEBUG [member: 'jenkins-hbase4.apache.org,33823,1676570504737' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:47,128 DEBUG [member: 'jenkins-hbase4.apache.org,33823,1676570504737' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-16 18:01:47,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:47,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:47,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1676570504765 2023-02-16 18:01:47,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:47,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:47,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1676570504765 2023-02-16 18:01:47,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:47,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,33823,1676570504737': 2023-02-16 18:01:47,131 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33823,1676570504737' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-16 18:01:47,131 INFO [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-16 18:01:47,131 DEBUG [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 18:01:47,131 DEBUG [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 18:01:47,131 DEBUG [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,131 INFO [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-16 18:01:47,132 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x1005e4b97b00002, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,132 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,132 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:33823-0x1005e4b97b00001, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:47,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 18:01:47,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,132 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:33823-0x1005e4b97b00001, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 18:01:47,132 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x1005e4b97b00002, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 18:01:47,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:47,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 18:01:47,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:47,133 DEBUG [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,39705,1676570504765 2023-02-16 18:01:47,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 18:01:47,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:47,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,133 DEBUG [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:47,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:47,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1676570504765 2023-02-16 18:01:47,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:47,134 DEBUG [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,39705,1676570504765 2023-02-16 18:01:47,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:47,135 DEBUG [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:47,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39705,1676570504765 2023-02-16 18:01:47,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:47,138 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:47,138 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x1005e4b97b00002, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 18:01:47,138 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:33823-0x1005e4b97b00001, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 18:01:47,138 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,138 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x1005e4b97b00002, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 18:01:47,138 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,39705,1676570504765 2023-02-16 18:01:47,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-16 18:01:47,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-16 18:01:47,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 18:01:47,138 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:33823-0x1005e4b97b00001, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 18:01:47,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:47,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 18:01:47,138 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,138 DEBUG [(jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:47,138 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:47,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:47,138 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,138 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,39705,1676570504765 2023-02-16 18:01:47,138 DEBUG [Listener at localhost/34323] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-16 18:01:47,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 18:01:47,139 DEBUG [Listener at localhost/34323] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-16 18:01:47,138 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 18:01:47,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:47,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:47,139 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,141 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-16 18:01:47,239 DEBUG [Listener at localhost/34323] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-16 18:01:47,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-16 18:01:47,244 INFO [Listener at localhost/34323] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676570506622 type: FLUSH version: 2 ttl: 0 2023-02-16 18:01:47,244 DEBUG [Listener at localhost/34323] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:37837/user/jenkins/test-data/7e86229c-4b5f-576a-d817-000cf8fd0384/testWithMockedMapReduceSingleRegion/b7153447-1bdf-43fc-9106-3baca8aa2e65/data/default/testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,245 INFO [Listener at localhost/34323] snapshot.RestoreSnapshotHelper(239): region to add: aa306980a89e729430649cac92fad9b4 2023-02-16 18:01:47,245 INFO [Listener at localhost/34323] snapshot.RestoreSnapshotHelper(585): clone region=aa306980a89e729430649cac92fad9b4 as aa306980a89e729430649cac92fad9b4 in snapshot testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,245 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => aa306980a89e729430649cac92fad9b4, NAME => 'testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37837/user/jenkins/test-data/7e86229c-4b5f-576a-d817-000cf8fd0384/testWithMockedMapReduceSingleRegion/b7153447-1bdf-43fc-9106-3baca8aa2e65 2023-02-16 18:01:47,254 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:47,254 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1ae58be7b09945c380ac7c1ea846ba22 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,255 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 628f3354d04043a0b12ce330cf036e95 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,260 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing aa306980a89e729430649cac92fad9b4, disabling compactions & flushes 2023-02-16 18:01:47,260 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4. 2023-02-16 18:01:47,260 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4. 2023-02-16 18:01:47,260 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4. after waiting 0 ms 2023-02-16 18:01:47,260 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4. 2023-02-16 18:01:47,260 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4. 2023-02-16 18:01:47,260 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for aa306980a89e729430649cac92fad9b4: 2023-02-16 18:01:47,260 INFO [Listener at localhost/34323] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676570506622 type: FLUSH version: 2 ttl: 0 2023-02-16 18:01:47,260 DEBUG [Listener at localhost/34323] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:37837/user/jenkins/test-data/7e86229c-4b5f-576a-d817-000cf8fd0384/testWithMockedMapReduceSingleRegion/b7153447-1bdf-43fc-9106-3baca8aa2e65 2023-02-16 18:01:47,261 DEBUG [Listener at localhost/34323] util.CommonFSUtils(682): File system contents for path hdfs://localhost:37837/user/jenkins/test-data/7e86229c-4b5f-576a-d817-000cf8fd0384/testWithMockedMapReduceSingleRegion/b7153447-1bdf-43fc-9106-3baca8aa2e65 2023-02-16 18:01:47,261 DEBUG [Listener at localhost/34323] util.CommonFSUtils(699): |-data/ 2023-02-16 18:01:47,261 DEBUG [Listener at localhost/34323] util.CommonFSUtils(699): |----default/ 2023-02-16 18:01:47,262 DEBUG [Listener at localhost/34323] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-16 18:01:47,262 DEBUG [Listener at localhost/34323] util.CommonFSUtils(699): |----------aa306980a89e729430649cac92fad9b4/ 2023-02-16 18:01:47,262 DEBUG [Listener at localhost/34323] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 18:01:47,262 DEBUG [Listener at localhost/34323] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 18:01:47,262 DEBUG [Listener at localhost/34323] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=aa306980a89e729430649cac92fad9b4-1ae58be7b09945c380ac7c1ea846ba22 2023-02-16 18:01:47,263 DEBUG [Listener at localhost/34323] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 18:01:47,263 DEBUG [Listener at localhost/34323] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=aa306980a89e729430649cac92fad9b4-628f3354d04043a0b12ce330cf036e95 2023-02-16 18:01:47,266 INFO [Listener at localhost/34323] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-16 18:01:47,269 DEBUG [Listener at localhost/34323] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:47,269 INFO [Listener at localhost/34323] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 18:01:47,272 DEBUG [Listener at localhost/34323] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:47,274 INFO [StoreOpener-aa306980a89e729430649cac92fad9b4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region aa306980a89e729430649cac92fad9b4 2023-02-16 18:01:47,275 DEBUG [StoreOpener-aa306980a89e729430649cac92fad9b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37837/user/jenkins/test-data/7e86229c-4b5f-576a-d817-000cf8fd0384/testWithMockedMapReduceSingleRegion/b7153447-1bdf-43fc-9106-3baca8aa2e65/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/f1 2023-02-16 18:01:47,275 INFO [StoreOpener-aa306980a89e729430649cac92fad9b4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aa306980a89e729430649cac92fad9b4 columnFamilyName f1 2023-02-16 18:01:47,279 DEBUG [StoreOpener-aa306980a89e729430649cac92fad9b4-1] regionserver.HStore(539): loaded hdfs://localhost:37837/user/jenkins/test-data/7e86229c-4b5f-576a-d817-000cf8fd0384/testWithMockedMapReduceSingleRegion/b7153447-1bdf-43fc-9106-3baca8aa2e65/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/f1/testWithMockedMapReduceSingleRegion=aa306980a89e729430649cac92fad9b4-1ae58be7b09945c380ac7c1ea846ba22 2023-02-16 18:01:47,279 INFO [StoreOpener-aa306980a89e729430649cac92fad9b4-1] regionserver.HStore(310): Store=aa306980a89e729430649cac92fad9b4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:47,279 INFO [StoreOpener-aa306980a89e729430649cac92fad9b4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region aa306980a89e729430649cac92fad9b4 2023-02-16 18:01:47,280 DEBUG [StoreOpener-aa306980a89e729430649cac92fad9b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37837/user/jenkins/test-data/7e86229c-4b5f-576a-d817-000cf8fd0384/testWithMockedMapReduceSingleRegion/b7153447-1bdf-43fc-9106-3baca8aa2e65/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/f2 2023-02-16 18:01:47,280 INFO [StoreOpener-aa306980a89e729430649cac92fad9b4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aa306980a89e729430649cac92fad9b4 columnFamilyName f2 2023-02-16 18:01:47,283 DEBUG [StoreOpener-aa306980a89e729430649cac92fad9b4-1] regionserver.HStore(539): loaded hdfs://localhost:37837/user/jenkins/test-data/7e86229c-4b5f-576a-d817-000cf8fd0384/testWithMockedMapReduceSingleRegion/b7153447-1bdf-43fc-9106-3baca8aa2e65/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/f2/testWithMockedMapReduceSingleRegion=aa306980a89e729430649cac92fad9b4-628f3354d04043a0b12ce330cf036e95 2023-02-16 18:01:47,284 INFO [StoreOpener-aa306980a89e729430649cac92fad9b4-1] regionserver.HStore(310): Store=aa306980a89e729430649cac92fad9b4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:47,284 DEBUG [Listener at localhost/34323] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:47,284 INFO [Listener at localhost/34323] regionserver.HRegion(1071): Opened aa306980a89e729430649cac92fad9b4; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66635921, jitterRate=-0.007047399878501892}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:47,284 DEBUG [Listener at localhost/34323] regionserver.HRegion(964): Region open journal for aa306980a89e729430649cac92fad9b4: 2023-02-16 18:01:47,334 DEBUG [Listener at localhost/34323] regionserver.HRegion(1603): Closing aa306980a89e729430649cac92fad9b4, disabling compactions & flushes 2023-02-16 18:01:47,334 INFO [Listener at localhost/34323] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4. 2023-02-16 18:01:47,334 DEBUG [Listener at localhost/34323] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4. 2023-02-16 18:01:47,334 DEBUG [Listener at localhost/34323] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4. after waiting 0 ms 2023-02-16 18:01:47,334 DEBUG [Listener at localhost/34323] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4. 2023-02-16 18:01:47,335 INFO [Listener at localhost/34323] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4. 2023-02-16 18:01:47,335 DEBUG [Listener at localhost/34323] regionserver.HRegion(1557): Region close journal for aa306980a89e729430649cac92fad9b4: 2023-02-16 18:01:47,340 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-16 18:01:47,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,343 INFO [Listener at localhost/34323] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,344 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 18:01:47,348 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676570507348"}]},"ts":"1676570507348"} 2023-02-16 18:01:47,361 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-16 18:01:47,363 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-16 18:01:47,364 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=aa306980a89e729430649cac92fad9b4, UNASSIGN}] 2023-02-16 18:01:47,365 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=aa306980a89e729430649cac92fad9b4, UNASSIGN 2023-02-16 18:01:47,366 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=aa306980a89e729430649cac92fad9b4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:47,366 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676570507366"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570507366"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570507366"}]},"ts":"1676570507366"} 2023-02-16 18:01:47,367 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure aa306980a89e729430649cac92fad9b4, server=jenkins-hbase4.apache.org,33823,1676570504737}] 2023-02-16 18:01:47,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 18:01:47,520 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close aa306980a89e729430649cac92fad9b4 2023-02-16 18:01:47,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing aa306980a89e729430649cac92fad9b4, disabling compactions & flushes 2023-02-16 18:01:47,520 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4. 2023-02-16 18:01:47,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4. 2023-02-16 18:01:47,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4. after waiting 0 ms 2023-02-16 18:01:47,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4. 2023-02-16 18:01:47,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 18:01:47,528 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4. 2023-02-16 18:01:47,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for aa306980a89e729430649cac92fad9b4: 2023-02-16 18:01:47,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed aa306980a89e729430649cac92fad9b4 2023-02-16 18:01:47,530 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=aa306980a89e729430649cac92fad9b4, regionState=CLOSED 2023-02-16 18:01:47,530 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676570507530"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570507530"}]},"ts":"1676570507530"} 2023-02-16 18:01:47,533 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-16 18:01:47,533 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure aa306980a89e729430649cac92fad9b4, server=jenkins-hbase4.apache.org,33823,1676570504737 in 165 msec 2023-02-16 18:01:47,535 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-16 18:01:47,535 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=aa306980a89e729430649cac92fad9b4, UNASSIGN in 169 msec 2023-02-16 18:01:47,535 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676570507535"}]},"ts":"1676570507535"} 2023-02-16 18:01:47,536 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-16 18:01:47,539 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-16 18:01:47,541 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 196 msec 2023-02-16 18:01:47,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 18:01:47,651 INFO [Listener at localhost/34323] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-16 18:01:47,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,659 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,660 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-16 18:01:47,663 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/.tmp/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4 2023-02-16 18:01:47,665 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/.tmp/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/f1, FileablePath, hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/.tmp/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/f2, FileablePath, hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/.tmp/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/recovered.edits] 2023-02-16 18:01:47,669 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/.tmp/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/f1/1ae58be7b09945c380ac7c1ea846ba22 to hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/archive/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/f1/1ae58be7b09945c380ac7c1ea846ba22 2023-02-16 18:01:47,671 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/.tmp/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/f1/ba5184c6bf2f424d94b3ca35366ce757 to hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/archive/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/f1/ba5184c6bf2f424d94b3ca35366ce757 2023-02-16 18:01:47,675 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/.tmp/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/f2/628f3354d04043a0b12ce330cf036e95 to hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/archive/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/f2/628f3354d04043a0b12ce330cf036e95 2023-02-16 18:01:47,676 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/.tmp/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/f2/bd52fad468884feeade9da86caa82570 to hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/archive/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/f2/bd52fad468884feeade9da86caa82570 2023-02-16 18:01:47,679 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/.tmp/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/recovered.edits/12.seqid to hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/archive/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4/recovered.edits/12.seqid 2023-02-16 18:01:47,680 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/.tmp/data/default/testWithMockedMapReduceSingleRegion/aa306980a89e729430649cac92fad9b4 2023-02-16 18:01:47,680 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-16 18:01:47,683 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,685 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-16 18:01:47,687 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-16 18:01:47,688 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,688 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-16 18:01:47,688 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676570507688"}]},"ts":"9223372036854775807"} 2023-02-16 18:01:47,689 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-16 18:01:47,690 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => aa306980a89e729430649cac92fad9b4, NAME => 'testWithMockedMapReduceSingleRegion,,1676570505804.aa306980a89e729430649cac92fad9b4.', STARTKEY => '', ENDKEY => ''}] 2023-02-16 18:01:47,690 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-16 18:01:47,690 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676570507690"}]},"ts":"9223372036854775807"} 2023-02-16 18:01:47,691 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-16 18:01:47,699 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-16 18:01:47,700 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 42 msec 2023-02-16 18:01:47,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45797] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-16 18:01:47,762 INFO [Listener at localhost/34323] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-16 18:01:47,763 INFO [Listener at localhost/34323] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-16 18:01:47,763 INFO [Listener at localhost/34323] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-16 18:01:47,763 DEBUG [Listener at localhost/34323] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a3982d8 to 127.0.0.1:50386 2023-02-16 18:01:47,763 DEBUG [Listener at localhost/34323] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:47,763 DEBUG [Listener at localhost/34323] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-16 18:01:47,763 DEBUG [Listener at localhost/34323] util.JVMClusterUtil(257): Found active master hash=1898917391, stopped=false 2023-02-16 18:01:47,764 INFO [Listener at localhost/34323] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,45797,1676570504700 2023-02-16 18:01:47,766 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x1005e4b97b00002, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:47,766 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:47,766 INFO [Listener at localhost/34323] procedure2.ProcedureExecutor(629): Stopping 2023-02-16 18:01:47,766 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:33823-0x1005e4b97b00001, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:47,766 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:47,768 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39705-0x1005e4b97b00002, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:47,768 DEBUG [Listener at localhost/34323] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x305c5457 to 127.0.0.1:50386 2023-02-16 18:01:47,768 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:47,768 DEBUG [Listener at localhost/34323] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:47,768 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33823-0x1005e4b97b00001, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:47,768 INFO [Listener at localhost/34323] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,33823,1676570504737' ***** 2023-02-16 18:01:47,768 INFO [Listener at localhost/34323] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 18:01:47,769 INFO [Listener at localhost/34323] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39705,1676570504765' ***** 2023-02-16 18:01:47,769 INFO [RS:0;jenkins-hbase4:33823] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 18:01:47,769 INFO [Listener at localhost/34323] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 18:01:47,769 INFO [RS:0;jenkins-hbase4:33823] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 18:01:47,769 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 18:01:47,770 INFO [RS:0;jenkins-hbase4:33823] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 18:01:47,770 INFO [RS:1;jenkins-hbase4:39705] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 18:01:47,770 INFO [RS:0;jenkins-hbase4:33823] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:47,770 INFO [RS:1;jenkins-hbase4:39705] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 18:01:47,770 DEBUG [RS:0;jenkins-hbase4:33823] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x30ef7f53 to 127.0.0.1:50386 2023-02-16 18:01:47,770 INFO [RS:1;jenkins-hbase4:39705] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 18:01:47,770 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 18:01:47,770 INFO [RS:1;jenkins-hbase4:39705] regionserver.HRegionServer(3304): Received CLOSE for 56285a232411105e5a4f967d730fc6b3 2023-02-16 18:01:47,770 DEBUG [RS:0;jenkins-hbase4:33823] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:47,771 INFO [RS:0;jenkins-hbase4:33823] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,33823,1676570504737; all regions closed. 2023-02-16 18:01:47,771 INFO [RS:1;jenkins-hbase4:39705] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39705,1676570504765 2023-02-16 18:01:47,771 DEBUG [RS:1;jenkins-hbase4:39705] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x48bfd6d5 to 127.0.0.1:50386 2023-02-16 18:01:47,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 56285a232411105e5a4f967d730fc6b3, disabling compactions & flushes 2023-02-16 18:01:47,771 DEBUG [RS:1;jenkins-hbase4:39705] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:47,771 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676570505319.56285a232411105e5a4f967d730fc6b3. 2023-02-16 18:01:47,771 INFO [RS:1;jenkins-hbase4:39705] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 18:01:47,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676570505319.56285a232411105e5a4f967d730fc6b3. 2023-02-16 18:01:47,772 INFO [RS:1;jenkins-hbase4:39705] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 18:01:47,772 INFO [RS:1;jenkins-hbase4:39705] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 18:01:47,772 INFO [RS:1;jenkins-hbase4:39705] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-16 18:01:47,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676570505319.56285a232411105e5a4f967d730fc6b3. after waiting 0 ms 2023-02-16 18:01:47,772 INFO [RS:1;jenkins-hbase4:39705] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-16 18:01:47,772 DEBUG [RS:1;jenkins-hbase4:39705] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 56285a232411105e5a4f967d730fc6b3=hbase:namespace,,1676570505319.56285a232411105e5a4f967d730fc6b3.} 2023-02-16 18:01:47,772 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 18:01:47,772 DEBUG [RS:1;jenkins-hbase4:39705] regionserver.HRegionServer(1505): Waiting on 1588230740, 56285a232411105e5a4f967d730fc6b3 2023-02-16 18:01:47,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676570505319.56285a232411105e5a4f967d730fc6b3. 2023-02-16 18:01:47,772 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 18:01:47,772 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 56285a232411105e5a4f967d730fc6b3 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-16 18:01:47,772 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 18:01:47,772 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 18:01:47,772 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 18:01:47,772 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-16 18:01:47,775 DEBUG [RS:0;jenkins-hbase4:33823] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/oldWALs 2023-02-16 18:01:47,775 INFO [RS:0;jenkins-hbase4:33823] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33823%2C1676570504737:(num 1676570506057) 2023-02-16 18:01:47,775 DEBUG [RS:0;jenkins-hbase4:33823] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:47,776 INFO [RS:0;jenkins-hbase4:33823] regionserver.LeaseManager(133): Closed leases 2023-02-16 18:01:47,776 INFO [RS:0;jenkins-hbase4:33823] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-16 18:01:47,776 INFO [RS:0;jenkins-hbase4:33823] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 18:01:47,776 INFO [RS:0;jenkins-hbase4:33823] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 18:01:47,776 INFO [RS:0;jenkins-hbase4:33823] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 18:01:47,776 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 18:01:47,777 INFO [RS:0;jenkins-hbase4:33823] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33823 2023-02-16 18:01:47,781 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:33823-0x1005e4b97b00001, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:47,781 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:47,781 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x1005e4b97b00002, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33823,1676570504737 2023-02-16 18:01:47,781 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x1005e4b97b00002, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:47,782 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33823,1676570504737] 2023-02-16 18:01:47,782 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33823,1676570504737; numProcessing=1 2023-02-16 18:01:47,783 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33823,1676570504737 already deleted, retry=false 2023-02-16 18:01:47,783 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33823,1676570504737 expired; onlineServers=1 2023-02-16 18:01:47,788 ERROR [Listener at localhost/34323-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5318441 rejected from java.util.concurrent.ThreadPoolExecutor@10e003f[Shutting down, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:47,788 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:33823-0x1005e4b97b00001, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:47,788 ERROR [Listener at localhost/34323-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7c9839a7 rejected from java.util.concurrent.ThreadPoolExecutor@10e003f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:47,791 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/hbase/namespace/56285a232411105e5a4f967d730fc6b3/.tmp/info/5e9a0cc720d34f619b6ee08642a92bcb 2023-02-16 18:01:47,792 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.57 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/hbase/meta/1588230740/.tmp/info/734f3d59dab140ef8934ad25389a7a2d 2023-02-16 18:01:47,796 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 734f3d59dab140ef8934ad25389a7a2d 2023-02-16 18:01:47,797 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/hbase/namespace/56285a232411105e5a4f967d730fc6b3/.tmp/info/5e9a0cc720d34f619b6ee08642a92bcb as hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/hbase/namespace/56285a232411105e5a4f967d730fc6b3/info/5e9a0cc720d34f619b6ee08642a92bcb 2023-02-16 18:01:47,801 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/hbase/namespace/56285a232411105e5a4f967d730fc6b3/info/5e9a0cc720d34f619b6ee08642a92bcb, entries=2, sequenceid=6, filesize=4.8 K 2023-02-16 18:01:47,801 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 56285a232411105e5a4f967d730fc6b3 in 29ms, sequenceid=6, compaction requested=false 2023-02-16 18:01:47,809 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/hbase/meta/1588230740/.tmp/rep_barrier/acc47ba942054461b15d4763dbbfdc41 2023-02-16 18:01:47,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/hbase/namespace/56285a232411105e5a4f967d730fc6b3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-16 18:01:47,811 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676570505319.56285a232411105e5a4f967d730fc6b3. 2023-02-16 18:01:47,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 56285a232411105e5a4f967d730fc6b3: 2023-02-16 18:01:47,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676570505319.56285a232411105e5a4f967d730fc6b3. 2023-02-16 18:01:47,813 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for acc47ba942054461b15d4763dbbfdc41 2023-02-16 18:01:47,820 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/hbase/meta/1588230740/.tmp/table/8a12e1c05a5243409bfb2021e608e258 2023-02-16 18:01:47,823 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8a12e1c05a5243409bfb2021e608e258 2023-02-16 18:01:47,823 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/hbase/meta/1588230740/.tmp/info/734f3d59dab140ef8934ad25389a7a2d as hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/hbase/meta/1588230740/info/734f3d59dab140ef8934ad25389a7a2d 2023-02-16 18:01:47,827 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 734f3d59dab140ef8934ad25389a7a2d 2023-02-16 18:01:47,827 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/hbase/meta/1588230740/info/734f3d59dab140ef8934ad25389a7a2d, entries=12, sequenceid=21, filesize=6.3 K 2023-02-16 18:01:47,827 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/hbase/meta/1588230740/.tmp/rep_barrier/acc47ba942054461b15d4763dbbfdc41 as hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/hbase/meta/1588230740/rep_barrier/acc47ba942054461b15d4763dbbfdc41 2023-02-16 18:01:47,831 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for acc47ba942054461b15d4763dbbfdc41 2023-02-16 18:01:47,831 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/hbase/meta/1588230740/rep_barrier/acc47ba942054461b15d4763dbbfdc41, entries=1, sequenceid=21, filesize=5.0 K 2023-02-16 18:01:47,831 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/hbase/meta/1588230740/.tmp/table/8a12e1c05a5243409bfb2021e608e258 as hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/hbase/meta/1588230740/table/8a12e1c05a5243409bfb2021e608e258 2023-02-16 18:01:47,834 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 18:01:47,835 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8a12e1c05a5243409bfb2021e608e258 2023-02-16 18:01:47,835 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/hbase/meta/1588230740/table/8a12e1c05a5243409bfb2021e608e258, entries=4, sequenceid=21, filesize=5.1 K 2023-02-16 18:01:47,838 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 66ms, sequenceid=21, compaction requested=false 2023-02-16 18:01:47,840 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 18:01:47,842 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-16 18:01:47,842 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 18:01:47,843 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 18:01:47,843 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 18:01:47,843 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-16 18:01:47,965 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:33823-0x1005e4b97b00001, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:47,965 INFO [RS:0;jenkins-hbase4:33823] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,33823,1676570504737; zookeeper connection closed. 2023-02-16 18:01:47,965 ERROR [Listener at localhost/34323-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@47c409e rejected from java.util.concurrent.ThreadPoolExecutor@10e003f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:47,968 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7bb28775] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7bb28775 2023-02-16 18:01:47,968 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:33823-0x1005e4b97b00001, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:47,968 ERROR [Listener at localhost/34323-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@19cb3117 rejected from java.util.concurrent.ThreadPoolExecutor@10e003f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:47,972 INFO [RS:1;jenkins-hbase4:39705] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39705,1676570504765; all regions closed. 2023-02-16 18:01:47,976 DEBUG [RS:1;jenkins-hbase4:39705] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/oldWALs 2023-02-16 18:01:47,976 INFO [RS:1;jenkins-hbase4:39705] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39705%2C1676570504765.meta:.meta(num 1676570505258) 2023-02-16 18:01:47,980 DEBUG [RS:1;jenkins-hbase4:39705] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/oldWALs 2023-02-16 18:01:47,980 INFO [RS:1;jenkins-hbase4:39705] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39705%2C1676570504765:(num 1676570505668) 2023-02-16 18:01:47,980 DEBUG [RS:1;jenkins-hbase4:39705] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:47,980 INFO [RS:1;jenkins-hbase4:39705] regionserver.LeaseManager(133): Closed leases 2023-02-16 18:01:47,980 INFO [RS:1;jenkins-hbase4:39705] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-16 18:01:47,980 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 18:01:47,981 INFO [RS:1;jenkins-hbase4:39705] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39705 2023-02-16 18:01:47,982 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x1005e4b97b00002, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39705,1676570504765 2023-02-16 18:01:47,982 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:47,982 ERROR [Listener at localhost/34323-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@50572ce2 rejected from java.util.concurrent.ThreadPoolExecutor@5468b230[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:47,984 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39705,1676570504765] 2023-02-16 18:01:47,984 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39705,1676570504765; numProcessing=2 2023-02-16 18:01:47,985 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39705,1676570504765 already deleted, retry=false 2023-02-16 18:01:47,985 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39705,1676570504765 expired; onlineServers=0 2023-02-16 18:01:47,985 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45797,1676570504700' ***** 2023-02-16 18:01:47,985 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-16 18:01:47,986 DEBUG [M:0;jenkins-hbase4:45797] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7510b4f2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 18:01:47,986 INFO [M:0;jenkins-hbase4:45797] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45797,1676570504700 2023-02-16 18:01:47,986 INFO [M:0;jenkins-hbase4:45797] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45797,1676570504700; all regions closed. 2023-02-16 18:01:47,986 DEBUG [M:0;jenkins-hbase4:45797] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:47,986 DEBUG [M:0;jenkins-hbase4:45797] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-16 18:01:47,986 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-16 18:01:47,986 DEBUG [M:0;jenkins-hbase4:45797] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-16 18:01:47,986 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676570504910] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676570504910,5,FailOnTimeoutGroup] 2023-02-16 18:01:47,986 INFO [M:0;jenkins-hbase4:45797] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-16 18:01:47,986 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676570504910] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676570504910,5,FailOnTimeoutGroup] 2023-02-16 18:01:47,987 INFO [M:0;jenkins-hbase4:45797] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-16 18:01:47,987 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-16 18:01:47,987 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:47,987 INFO [M:0;jenkins-hbase4:45797] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-16 18:01:47,988 DEBUG [M:0;jenkins-hbase4:45797] master.HMaster(1512): Stopping service threads 2023-02-16 18:01:47,988 INFO [M:0;jenkins-hbase4:45797] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-16 18:01:47,988 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 18:01:47,988 ERROR [M:0;jenkins-hbase4:45797] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-16 18:01:47,988 INFO [M:0;jenkins-hbase4:45797] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-16 18:01:47,988 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-16 18:01:47,989 DEBUG [M:0;jenkins-hbase4:45797] zookeeper.ZKUtil(398): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-16 18:01:47,989 WARN [M:0;jenkins-hbase4:45797] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-16 18:01:47,989 INFO [M:0;jenkins-hbase4:45797] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-16 18:01:47,989 INFO [M:0;jenkins-hbase4:45797] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-16 18:01:47,989 DEBUG [M:0;jenkins-hbase4:45797] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 18:01:47,989 INFO [M:0;jenkins-hbase4:45797] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:47,989 DEBUG [M:0;jenkins-hbase4:45797] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:47,989 DEBUG [M:0;jenkins-hbase4:45797] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 18:01:47,989 DEBUG [M:0;jenkins-hbase4:45797] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:47,989 INFO [M:0;jenkins-hbase4:45797] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.14 KB heapSize=67.07 KB 2023-02-16 18:01:47,998 INFO [M:0;jenkins-hbase4:45797] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.14 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1e84e0ce4d7c45319ba3147b1844dc0e 2023-02-16 18:01:48,002 DEBUG [M:0;jenkins-hbase4:45797] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1e84e0ce4d7c45319ba3147b1844dc0e as hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1e84e0ce4d7c45319ba3147b1844dc0e 2023-02-16 18:01:48,005 INFO [M:0;jenkins-hbase4:45797] regionserver.HStore(1080): Added hdfs://localhost:37837/user/jenkins/test-data/b70e1c2f-d87f-edfa-6188-2ec734e5597c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1e84e0ce4d7c45319ba3147b1844dc0e, entries=17, sequenceid=132, filesize=8.7 K 2023-02-16 18:01:48,006 INFO [M:0;jenkins-hbase4:45797] regionserver.HRegion(2947): Finished flush of dataSize ~56.14 KB/57485, heapSize ~67.05 KB/68664, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false 2023-02-16 18:01:48,006 INFO [M:0;jenkins-hbase4:45797] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:48,006 DEBUG [M:0;jenkins-hbase4:45797] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 18:01:48,008 INFO [M:0;jenkins-hbase4:45797] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-16 18:01:48,008 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 18:01:48,009 INFO [M:0;jenkins-hbase4:45797] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45797 2023-02-16 18:01:48,012 DEBUG [M:0;jenkins-hbase4:45797] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,45797,1676570504700 already deleted, retry=false 2023-02-16 18:01:48,366 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:48,366 INFO [M:0;jenkins-hbase4:45797] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45797,1676570504700; zookeeper connection closed. 2023-02-16 18:01:48,366 ERROR [Listener at localhost/34323-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@27fbd738 rejected from java.util.concurrent.ThreadPoolExecutor@23c4471f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:48,367 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): master:45797-0x1005e4b97b00000, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:48,367 ERROR [Listener at localhost/34323-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2e51cae0 rejected from java.util.concurrent.ThreadPoolExecutor@23c4471f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:48,466 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x1005e4b97b00002, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:48,466 INFO [RS:1;jenkins-hbase4:39705] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39705,1676570504765; zookeeper connection closed. 2023-02-16 18:01:48,466 ERROR [Listener at localhost/34323-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@49e8b76d rejected from java.util.concurrent.ThreadPoolExecutor@5468b230[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:48,466 DEBUG [Listener at localhost/34323-EventThread] zookeeper.ZKWatcher(600): regionserver:39705-0x1005e4b97b00002, quorum=127.0.0.1:50386, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:48,466 ERROR [Listener at localhost/34323-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@31d97d9a rejected from java.util.concurrent.ThreadPoolExecutor@5468b230[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:48,466 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5ac3a467] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5ac3a467 2023-02-16 18:01:48,467 INFO [Listener at localhost/34323] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-16 18:01:48,468 WARN [Listener at localhost/34323] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 18:01:48,471 INFO [Listener at localhost/34323] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 18:01:48,576 WARN [BP-1850174634-172.31.14.131-1676570503903 heartbeating to localhost/127.0.0.1:37837] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 18:01:48,576 WARN [BP-1850174634-172.31.14.131-1676570503903 heartbeating to localhost/127.0.0.1:37837] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1850174634-172.31.14.131-1676570503903 (Datanode Uuid f9e07f23-4cd8-4e65-bbbc-cc5409b820f5) service to localhost/127.0.0.1:37837 2023-02-16 18:01:48,577 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07dde6f3-a48b-c203-4130-4ef7675c69c6/cluster_879cd88e-8801-043b-c58a-e39e57b604b1/dfs/data/data3/current/BP-1850174634-172.31.14.131-1676570503903] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 18:01:48,577 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07dde6f3-a48b-c203-4130-4ef7675c69c6/cluster_879cd88e-8801-043b-c58a-e39e57b604b1/dfs/data/data4/current/BP-1850174634-172.31.14.131-1676570503903] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 18:01:48,578 WARN [Listener at localhost/34323] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 18:01:48,581 INFO [Listener at localhost/34323] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 18:01:48,686 WARN [BP-1850174634-172.31.14.131-1676570503903 heartbeating to localhost/127.0.0.1:37837] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 18:01:48,686 WARN [BP-1850174634-172.31.14.131-1676570503903 heartbeating to localhost/127.0.0.1:37837] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1850174634-172.31.14.131-1676570503903 (Datanode Uuid 4b5a5bf5-ab46-425f-a7ef-fc87d4ba6f5a) service to localhost/127.0.0.1:37837 2023-02-16 18:01:48,687 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07dde6f3-a48b-c203-4130-4ef7675c69c6/cluster_879cd88e-8801-043b-c58a-e39e57b604b1/dfs/data/data1/current/BP-1850174634-172.31.14.131-1676570503903] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 18:01:48,687 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07dde6f3-a48b-c203-4130-4ef7675c69c6/cluster_879cd88e-8801-043b-c58a-e39e57b604b1/dfs/data/data2/current/BP-1850174634-172.31.14.131-1676570503903] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 18:01:48,698 INFO [Listener at localhost/34323] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 18:01:48,813 INFO [Listener at localhost/34323] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-16 18:01:48,827 INFO [Listener at localhost/34323] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-16 18:01:48,839 INFO [Listener at localhost/34323] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=252 (was 228) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,45797,1676570504700)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1124632911) connection to localhost/127.0.0.1:37837 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1124632911) connection to localhost/127.0.0.1:37837 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34323 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1124632911) connection to localhost/127.0.0.1:37837 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34323.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1124632911) connection to localhost/127.0.0.1:37837 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins@localhost:37837 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost:37837 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost:37837 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=654 (was 637) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=266 (was 281), ProcessCount=170 (was 170), AvailableMemoryMB=1084 (was 1200) 2023-02-16 18:01:48,850 INFO [Listener at localhost/34323] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=252, OpenFileDescriptor=654, MaxFileDescriptor=60000, SystemLoadAverage=266, ProcessCount=170, AvailableMemoryMB=1084 2023-02-16 18:01:48,860 INFO [Listener at localhost/34323] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07dde6f3-a48b-c203-4130-4ef7675c69c6/hadoop.log.dir so I do NOT create it in target/test-data/1312edfc-6697-ba4e-cb98-30a3eded32e2 2023-02-16 18:01:48,860 WARN [Listener at localhost/34323] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07dde6f3-a48b-c203-4130-4ef7675c69c6/hadoop.log.dir Erasing configuration value by system value. 2023-02-16 18:01:48,860 INFO [Listener at localhost/34323] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07dde6f3-a48b-c203-4130-4ef7675c69c6/hadoop.tmp.dir so I do NOT create it in target/test-data/1312edfc-6697-ba4e-cb98-30a3eded32e2 2023-02-16 18:01:48,860 WARN [Listener at localhost/34323] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07dde6f3-a48b-c203-4130-4ef7675c69c6/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-16 18:01:48,860 DEBUG [Listener at localhost/34323] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1312edfc-6697-ba4e-cb98-30a3eded32e2 2023-02-16 18:01:48,860 INFO [Listener at localhost/34323] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-16 18:01:48,860 INFO [Listener at localhost/34323] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1312edfc-6697-ba4e-cb98-30a3eded32e2/cluster_2a5e7b90-fe00-c162-ecb0-a51feafcdfef, deleteOnExit=true 2023-02-16 18:01:48,860 INFO [Listener at localhost/34323] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-16 18:01:48,861 INFO [Listener at localhost/34323] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1312edfc-6697-ba4e-cb98-30a3eded32e2/test.cache.data in system properties and HBase conf 2023-02-16 18:01:48,861 INFO [Listener at localhost/34323] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1312edfc-6697-ba4e-cb98-30a3eded32e2/hadoop.tmp.dir in system properties and HBase conf 2023-02-16 18:01:48,861 INFO [Listener at localhost/34323] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1312edfc-6697-ba4e-cb98-30a3eded32e2/hadoop.log.dir in system properties and HBase conf 2023-02-16 18:01:48,861 INFO [Listener at localhost/34323] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1312edfc-6697-ba4e-cb98-30a3eded32e2/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-16 18:01:48,861 INFO [Listener at localhost/34323] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1312edfc-6697-ba4e-cb98-30a3eded32e2/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-16 18:01:48,861 INFO [Listener at localhost/34323] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-16 18:01:48,861 DEBUG [Listener at localhost/34323] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-16 18:01:48,861 INFO [Listener at localhost/34323] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1312edfc-6697-ba4e-cb98-30a3eded32e2/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-16 18:01:48,861 INFO [Listener at localhost/34323] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1312edfc-6697-ba4e-cb98-30a3eded32e2/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-16 18:01:48,861 INFO [Listener at localhost/34323] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1312edfc-6697-ba4e-cb98-30a3eded32e2/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-16 18:01:48,862 INFO [Listener at localhost/34323] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1312edfc-6697-ba4e-cb98-30a3eded32e2/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 18:01:48,862 INFO [Listener at localhost/34323] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1312edfc-6697-ba4e-cb98-30a3eded32e2/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-16 18:01:48,862 INFO [Listener at localhost/34323] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1312edfc-6697-ba4e-cb98-30a3eded32e2/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-16 18:01:48,862 INFO [Listener at localhost/34323] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1312edfc-6697-ba4e-cb98-30a3eded32e2/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 18:01:48,862 INFO [Listener at localhost/34323] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1312edfc-6697-ba4e-cb98-30a3eded32e2/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 18:01:48,862 INFO [Listener at localhost/34323] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1312edfc-6697-ba4e-cb98-30a3eded32e2/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-16 18:01:48,862 INFO [Listener at localhost/34323] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1312edfc-6697-ba4e-cb98-30a3eded32e2/nfs.dump.dir in system properties and HBase conf 2023-02-16 18:01:48,862 INFO [Listener at localhost/34323] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1312edfc-6697-ba4e-cb98-30a3eded32e2/java.io.tmpdir in system properties and HBase conf 2023-02-16 18:01:48,862 INFO [Listener at localhost/34323] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1312edfc-6697-ba4e-cb98-30a3eded32e2/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 18:01:48,862 INFO [Listener at localhost/34323] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1312edfc-6697-ba4e-cb98-30a3eded32e2/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-16 18:01:48,862 INFO [Listener at localhost/34323] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1312edfc-6697-ba4e-cb98-30a3eded32e2/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-16 18:01:48,867 WARN [Listener at localhost/34323] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 18:01:48,867 WARN [Listener at localhost/34323] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 18:01:48,906 WARN [Listener at localhost/34323] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 18:01:48,908 INFO [Listener at localhost/34323] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 18:01:48,912 INFO [Listener at localhost/34323] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1312edfc-6697-ba4e-cb98-30a3eded32e2/java.io.tmpdir/Jetty_localhost_34159_hdfs____r2n4u6/webapp 2023-02-16 18:01:49,012 INFO [Listener at localhost/34323] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34159 2023-02-16 18:01:49,017 WARN [Listener at localhost/34323] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 18:01:49,017 WARN [Listener at localhost/34323] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 18:01:49,062 WARN [Listener at localhost/41483] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 18:01:49,073 WARN [Listener at localhost/41483] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 18:01:49,075 WARN [Listener at localhost/41483] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 18:01:49,075 INFO [Listener at localhost/41483] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 18:01:49,079 INFO [Listener at localhost/41483] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1312edfc-6697-ba4e-cb98-30a3eded32e2/java.io.tmpdir/Jetty_localhost_42253_datanode____.a8t9fr/webapp 2023-02-16 18:01:49,173 INFO [Listener at localhost/41483] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42253 2023-02-16 18:01:49,180 WARN [Listener at localhost/44239] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 18:01:49,193 WARN [Listener at localhost/44239] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 18:01:49,194 WARN [Listener at localhost/44239] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 18:01:49,195 INFO [Listener at localhost/44239] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 18:01:49,198 INFO [Listener at localhost/44239] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1312edfc-6697-ba4e-cb98-30a3eded32e2/java.io.tmpdir/Jetty_localhost_37699_datanode____xcwyxl/webapp 2023-02-16 18:01:49,270 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x69af164a708215f1: Processing first storage report for DS-6a8bac80-480a-49bf-9247-3d9c131e0e67 from datanode 3f72dc86-c384-4af2-a06b-720a0e979fe9 2023-02-16 18:01:49,270 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x69af164a708215f1: from storage DS-6a8bac80-480a-49bf-9247-3d9c131e0e67 node DatanodeRegistration(127.0.0.1:39631, datanodeUuid=3f72dc86-c384-4af2-a06b-720a0e979fe9, infoPort=44401, infoSecurePort=0, ipcPort=44239, storageInfo=lv=-57;cid=testClusterID;nsid=527712442;c=1676570508869), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 18:01:49,270 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x69af164a708215f1: Processing first storage report for DS-ed69cdf8-17f3-47d5-9bf7-4aa913ed244b from datanode 3f72dc86-c384-4af2-a06b-720a0e979fe9 2023-02-16 18:01:49,270 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x69af164a708215f1: from storage DS-ed69cdf8-17f3-47d5-9bf7-4aa913ed244b node DatanodeRegistration(127.0.0.1:39631, datanodeUuid=3f72dc86-c384-4af2-a06b-720a0e979fe9, infoPort=44401, infoSecurePort=0, ipcPort=44239, storageInfo=lv=-57;cid=testClusterID;nsid=527712442;c=1676570508869), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 18:01:49,300 INFO [Listener at localhost/44239] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37699 2023-02-16 18:01:49,333 WARN [Listener at localhost/38001] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 18:01:49,437 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8ade70ee099de01c: Processing first storage report for DS-3e4e5de8-6fc2-4c41-869e-66648bb9ad0c from datanode 3f37fcee-c022-41c2-b7c5-26cf409e6de3 2023-02-16 18:01:49,437 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8ade70ee099de01c: from storage DS-3e4e5de8-6fc2-4c41-869e-66648bb9ad0c node DatanodeRegistration(127.0.0.1:32857, datanodeUuid=3f37fcee-c022-41c2-b7c5-26cf409e6de3, infoPort=45473, infoSecurePort=0, ipcPort=38001, storageInfo=lv=-57;cid=testClusterID;nsid=527712442;c=1676570508869), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 18:01:49,437 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8ade70ee099de01c: Processing first storage report for DS-df2a55f7-4aab-4220-9acb-710fabaa1c41 from datanode 3f37fcee-c022-41c2-b7c5-26cf409e6de3 2023-02-16 18:01:49,437 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8ade70ee099de01c: from storage DS-df2a55f7-4aab-4220-9acb-710fabaa1c41 node DatanodeRegistration(127.0.0.1:32857, datanodeUuid=3f37fcee-c022-41c2-b7c5-26cf409e6de3, infoPort=45473, infoSecurePort=0, ipcPort=38001, storageInfo=lv=-57;cid=testClusterID;nsid=527712442;c=1676570508869), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 18:01:49,446 DEBUG [Listener at localhost/38001] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1312edfc-6697-ba4e-cb98-30a3eded32e2 2023-02-16 18:01:49,448 INFO [Listener at localhost/38001] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1312edfc-6697-ba4e-cb98-30a3eded32e2/cluster_2a5e7b90-fe00-c162-ecb0-a51feafcdfef/zookeeper_0, clientPort=52063, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1312edfc-6697-ba4e-cb98-30a3eded32e2/cluster_2a5e7b90-fe00-c162-ecb0-a51feafcdfef/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1312edfc-6697-ba4e-cb98-30a3eded32e2/cluster_2a5e7b90-fe00-c162-ecb0-a51feafcdfef/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-16 18:01:49,449 INFO [Listener at localhost/38001] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=52063 2023-02-16 18:01:49,449 INFO [Listener at localhost/38001] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:49,450 INFO [Listener at localhost/38001] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:49,468 INFO [Listener at localhost/38001] util.FSUtils(479): Created version file at hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a with version=8 2023-02-16 18:01:49,468 INFO [Listener at localhost/38001] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:49,469 INFO [Listener at localhost/38001] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:49,470 INFO [Listener at localhost/38001] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:41483/user/jenkins/test-data/2bb84fc3-5066-ab2f-f1fc-5f43fa4014ec/hbase-staging 2023-02-16 18:01:49,472 INFO [Listener at localhost/38001] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 18:01:49,472 INFO [Listener at localhost/38001] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:49,472 INFO [Listener at localhost/38001] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:49,472 INFO [Listener at localhost/38001] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 18:01:49,472 INFO [Listener at localhost/38001] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:49,472 INFO [Listener at localhost/38001] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 18:01:49,472 INFO [Listener at localhost/38001] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 18:01:49,473 INFO [Listener at localhost/38001] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43375 2023-02-16 18:01:49,474 INFO [Listener at localhost/38001] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:49,474 INFO [Listener at localhost/38001] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:49,475 INFO [Listener at localhost/38001] zookeeper.RecoverableZooKeeper(93): Process identifier=master:43375 connecting to ZooKeeper ensemble=127.0.0.1:52063 2023-02-16 18:01:49,482 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:433750x0, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 18:01:49,483 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:43375-0x1005e4baa4d0000 connected 2023-02-16 18:01:49,499 DEBUG [Listener at localhost/38001] zookeeper.ZKUtil(164): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 18:01:49,499 DEBUG [Listener at localhost/38001] zookeeper.ZKUtil(164): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:49,499 DEBUG [Listener at localhost/38001] zookeeper.ZKUtil(164): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 18:01:49,500 DEBUG [Listener at localhost/38001] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43375 2023-02-16 18:01:49,500 DEBUG [Listener at localhost/38001] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43375 2023-02-16 18:01:49,504 DEBUG [Listener at localhost/38001] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43375 2023-02-16 18:01:49,506 DEBUG [Listener at localhost/38001] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43375 2023-02-16 18:01:49,506 DEBUG [Listener at localhost/38001] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43375 2023-02-16 18:01:49,506 INFO [Listener at localhost/38001] master.HMaster(444): hbase.rootdir=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a, hbase.cluster.distributed=false 2023-02-16 18:01:49,518 INFO [Listener at localhost/38001] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 18:01:49,518 INFO [Listener at localhost/38001] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:49,518 INFO [Listener at localhost/38001] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:49,518 INFO [Listener at localhost/38001] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 18:01:49,519 INFO [Listener at localhost/38001] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:49,519 INFO [Listener at localhost/38001] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 18:01:49,519 INFO [Listener at localhost/38001] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 18:01:49,519 INFO [Listener at localhost/38001] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41975 2023-02-16 18:01:49,520 INFO [Listener at localhost/38001] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 18:01:49,520 DEBUG [Listener at localhost/38001] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:49,521 INFO [Listener at localhost/38001] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:49,522 INFO [Listener at localhost/38001] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:49,522 INFO [Listener at localhost/38001] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41975 connecting to ZooKeeper ensemble=127.0.0.1:52063 2023-02-16 18:01:49,524 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): regionserver:419750x0, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 18:01:49,525 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41975-0x1005e4baa4d0001 connected 2023-02-16 18:01:49,525 DEBUG [Listener at localhost/38001] zookeeper.ZKUtil(164): regionserver:41975-0x1005e4baa4d0001, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 18:01:49,526 DEBUG [Listener at localhost/38001] zookeeper.ZKUtil(164): regionserver:41975-0x1005e4baa4d0001, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:49,526 DEBUG [Listener at localhost/38001] zookeeper.ZKUtil(164): regionserver:41975-0x1005e4baa4d0001, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 18:01:49,527 DEBUG [Listener at localhost/38001] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41975 2023-02-16 18:01:49,528 DEBUG [Listener at localhost/38001] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41975 2023-02-16 18:01:49,530 DEBUG [Listener at localhost/38001] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41975 2023-02-16 18:01:49,533 DEBUG [Listener at localhost/38001] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41975 2023-02-16 18:01:49,533 DEBUG [Listener at localhost/38001] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41975 2023-02-16 18:01:49,544 INFO [Listener at localhost/38001] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 18:01:49,544 INFO [Listener at localhost/38001] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:49,544 INFO [Listener at localhost/38001] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:49,544 INFO [Listener at localhost/38001] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 18:01:49,544 INFO [Listener at localhost/38001] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:49,544 INFO [Listener at localhost/38001] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 18:01:49,544 INFO [Listener at localhost/38001] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 18:01:49,545 INFO [Listener at localhost/38001] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38707 2023-02-16 18:01:49,545 INFO [Listener at localhost/38001] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 18:01:49,546 DEBUG [Listener at localhost/38001] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:49,546 INFO [Listener at localhost/38001] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:49,547 INFO [Listener at localhost/38001] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:49,548 INFO [Listener at localhost/38001] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38707 connecting to ZooKeeper ensemble=127.0.0.1:52063 2023-02-16 18:01:49,550 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): regionserver:387070x0, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 18:01:49,552 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38707-0x1005e4baa4d0002 connected 2023-02-16 18:01:49,552 DEBUG [Listener at localhost/38001] zookeeper.ZKUtil(164): regionserver:38707-0x1005e4baa4d0002, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 18:01:49,552 DEBUG [Listener at localhost/38001] zookeeper.ZKUtil(164): regionserver:38707-0x1005e4baa4d0002, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:49,552 DEBUG [Listener at localhost/38001] zookeeper.ZKUtil(164): regionserver:38707-0x1005e4baa4d0002, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 18:01:49,556 DEBUG [Listener at localhost/38001] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38707 2023-02-16 18:01:49,556 DEBUG [Listener at localhost/38001] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38707 2023-02-16 18:01:49,556 DEBUG [Listener at localhost/38001] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38707 2023-02-16 18:01:49,557 DEBUG [Listener at localhost/38001] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38707 2023-02-16 18:01:49,558 DEBUG [Listener at localhost/38001] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38707 2023-02-16 18:01:49,561 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,43375,1676570509471 2023-02-16 18:01:49,563 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 18:01:49,564 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,43375,1676570509471 2023-02-16 18:01:49,565 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 18:01:49,565 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): regionserver:41975-0x1005e4baa4d0001, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 18:01:49,565 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:49,565 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): regionserver:38707-0x1005e4baa4d0002, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 18:01:49,566 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 18:01:49,569 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,43375,1676570509471 from backup master directory 2023-02-16 18:01:49,569 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 18:01:49,570 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,43375,1676570509471 2023-02-16 18:01:49,570 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 18:01:49,570 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 18:01:49,570 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,43375,1676570509471 2023-02-16 18:01:49,584 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/hbase.id with ID: b095a163-567b-4548-bb63-369cdd9f2ba3 2023-02-16 18:01:49,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:49,594 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:49,602 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x31754d47 to 127.0.0.1:52063 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 18:01:49,610 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c3398de, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 18:01:49,610 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 18:01:49,610 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-16 18:01:49,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 18:01:49,612 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/MasterData/data/master/store-tmp 2023-02-16 18:01:49,622 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:49,622 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 18:01:49,622 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:49,622 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:49,622 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 18:01:49,622 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:49,622 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:49,622 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 18:01:49,622 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/MasterData/WALs/jenkins-hbase4.apache.org,43375,1676570509471 2023-02-16 18:01:49,624 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43375%2C1676570509471, suffix=, logDir=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/MasterData/WALs/jenkins-hbase4.apache.org,43375,1676570509471, archiveDir=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/MasterData/oldWALs, maxLogs=10 2023-02-16 18:01:49,638 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39631,DS-6a8bac80-480a-49bf-9247-3d9c131e0e67,DISK] 2023-02-16 18:01:49,638 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32857,DS-3e4e5de8-6fc2-4c41-869e-66648bb9ad0c,DISK] 2023-02-16 18:01:49,639 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/MasterData/WALs/jenkins-hbase4.apache.org,43375,1676570509471/jenkins-hbase4.apache.org%2C43375%2C1676570509471.1676570509625 2023-02-16 18:01:49,640 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39631,DS-6a8bac80-480a-49bf-9247-3d9c131e0e67,DISK], DatanodeInfoWithStorage[127.0.0.1:32857,DS-3e4e5de8-6fc2-4c41-869e-66648bb9ad0c,DISK]] 2023-02-16 18:01:49,640 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-16 18:01:49,640 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:49,640 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:49,640 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:49,641 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:49,642 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-16 18:01:49,642 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-16 18:01:49,643 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:49,643 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:49,643 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:49,645 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:49,646 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:49,646 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70786784, jitterRate=0.05480527877807617}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 18:01:49,647 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 18:01:49,647 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-16 18:01:49,649 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-16 18:01:49,649 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-16 18:01:49,649 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-16 18:01:49,649 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-16 18:01:49,649 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-16 18:01:49,649 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-16 18:01:49,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-16 18:01:49,650 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-16 18:01:49,660 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-16 18:01:49,660 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-16 18:01:49,661 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-16 18:01:49,661 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-16 18:01:49,661 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-16 18:01:49,664 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:49,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-16 18:01:49,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-16 18:01:49,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-16 18:01:49,666 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): regionserver:41975-0x1005e4baa4d0001, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:49,666 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:49,666 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): regionserver:38707-0x1005e4baa4d0002, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:49,667 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:49,667 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,43375,1676570509471, sessionid=0x1005e4baa4d0000, setting cluster-up flag (Was=false) 2023-02-16 18:01:49,674 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:49,678 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-16 18:01:49,679 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43375,1676570509471 2023-02-16 18:01:49,682 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:49,686 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-16 18:01:49,687 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43375,1676570509471 2023-02-16 18:01:49,687 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/.hbase-snapshot/.tmp 2023-02-16 18:01:49,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-16 18:01:49,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 18:01:49,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 18:01:49,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 18:01:49,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 18:01:49,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-16 18:01:49,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:49,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 18:01:49,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:49,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676570539698 2023-02-16 18:01:49,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-16 18:01:49,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-16 18:01:49,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-16 18:01:49,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-16 18:01:49,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-16 18:01:49,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-16 18:01:49,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:49,698 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 18:01:49,698 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-16 18:01:49,699 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-16 18:01:49,699 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-16 18:01:49,699 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-16 18:01:49,700 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-16 18:01:49,700 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-16 18:01:49,700 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 18:01:49,701 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676570509700,5,FailOnTimeoutGroup] 2023-02-16 18:01:49,704 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676570509702,5,FailOnTimeoutGroup] 2023-02-16 18:01:49,704 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:49,704 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-16 18:01:49,705 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:49,705 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:49,714 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 18:01:49,714 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 18:01:49,714 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a 2023-02-16 18:01:49,724 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:49,725 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 18:01:49,726 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/hbase/meta/1588230740/info 2023-02-16 18:01:49,726 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 18:01:49,727 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:49,727 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 18:01:49,728 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/hbase/meta/1588230740/rep_barrier 2023-02-16 18:01:49,728 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 18:01:49,728 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:49,729 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 18:01:49,729 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/hbase/meta/1588230740/table 2023-02-16 18:01:49,730 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 18:01:49,730 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:49,730 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/hbase/meta/1588230740 2023-02-16 18:01:49,731 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/hbase/meta/1588230740 2023-02-16 18:01:49,732 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 18:01:49,733 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 18:01:49,734 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:49,735 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68423483, jitterRate=0.019589349627494812}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 18:01:49,735 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 18:01:49,735 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 18:01:49,735 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 18:01:49,735 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 18:01:49,735 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 18:01:49,735 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 18:01:49,736 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 18:01:49,736 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 18:01:49,736 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 18:01:49,736 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-16 18:01:49,736 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-16 18:01:49,738 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-16 18:01:49,739 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-16 18:01:49,762 INFO [RS:0;jenkins-hbase4:41975] regionserver.HRegionServer(952): ClusterId : b095a163-567b-4548-bb63-369cdd9f2ba3 2023-02-16 18:01:49,762 INFO [RS:1;jenkins-hbase4:38707] regionserver.HRegionServer(952): ClusterId : b095a163-567b-4548-bb63-369cdd9f2ba3 2023-02-16 18:01:49,762 DEBUG [RS:0;jenkins-hbase4:41975] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 18:01:49,762 DEBUG [RS:1;jenkins-hbase4:38707] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 18:01:49,764 DEBUG [RS:1;jenkins-hbase4:38707] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 18:01:49,764 DEBUG [RS:0;jenkins-hbase4:41975] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 18:01:49,764 DEBUG [RS:0;jenkins-hbase4:41975] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 18:01:49,764 DEBUG [RS:1;jenkins-hbase4:38707] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 18:01:49,766 DEBUG [RS:1;jenkins-hbase4:38707] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 18:01:49,766 DEBUG [RS:0;jenkins-hbase4:41975] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 18:01:49,767 DEBUG [RS:1;jenkins-hbase4:38707] zookeeper.ReadOnlyZKClient(139): Connect 0x7f3ede3f to 127.0.0.1:52063 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 18:01:49,767 DEBUG [RS:0;jenkins-hbase4:41975] zookeeper.ReadOnlyZKClient(139): Connect 0x551c355c to 127.0.0.1:52063 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 18:01:49,772 DEBUG [RS:1;jenkins-hbase4:38707] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71f92fa8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 18:01:49,772 DEBUG [RS:0;jenkins-hbase4:41975] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5bdbd18f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 18:01:49,772 DEBUG [RS:1;jenkins-hbase4:38707] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@75c6b54f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 18:01:49,772 DEBUG [RS:0;jenkins-hbase4:41975] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5fe45e2c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 18:01:49,780 DEBUG [RS:1;jenkins-hbase4:38707] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:38707 2023-02-16 18:01:49,780 INFO [RS:1;jenkins-hbase4:38707] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 18:01:49,780 INFO [RS:1;jenkins-hbase4:38707] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 18:01:49,780 DEBUG [RS:1;jenkins-hbase4:38707] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 18:01:49,781 INFO [RS:1;jenkins-hbase4:38707] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,43375,1676570509471 with isa=jenkins-hbase4.apache.org/172.31.14.131:38707, startcode=1676570509543 2023-02-16 18:01:49,781 DEBUG [RS:1;jenkins-hbase4:38707] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 18:01:49,783 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39117, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 18:01:49,783 DEBUG [RS:0;jenkins-hbase4:41975] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:41975 2023-02-16 18:01:49,783 INFO [RS:0;jenkins-hbase4:41975] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 18:01:49,784 INFO [RS:0;jenkins-hbase4:41975] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 18:01:49,784 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:49,784 DEBUG [RS:0;jenkins-hbase4:41975] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 18:01:49,785 DEBUG [RS:1;jenkins-hbase4:38707] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a 2023-02-16 18:01:49,785 DEBUG [RS:1;jenkins-hbase4:38707] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:41483 2023-02-16 18:01:49,785 DEBUG [RS:1;jenkins-hbase4:38707] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 18:01:49,785 INFO [RS:0;jenkins-hbase4:41975] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,43375,1676570509471 with isa=jenkins-hbase4.apache.org/172.31.14.131:41975, startcode=1676570509518 2023-02-16 18:01:49,785 DEBUG [RS:0;jenkins-hbase4:41975] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 18:01:49,786 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:49,787 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44541, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 18:01:49,787 DEBUG [RS:1;jenkins-hbase4:38707] zookeeper.ZKUtil(162): regionserver:38707-0x1005e4baa4d0002, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:49,787 WARN [RS:1;jenkins-hbase4:38707] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 18:01:49,787 INFO [RS:1;jenkins-hbase4:38707] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 18:01:49,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41975,1676570509518 2023-02-16 18:01:49,788 DEBUG [RS:1;jenkins-hbase4:38707] regionserver.HRegionServer(1947): logDir=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/WALs/jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:49,788 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38707,1676570509543] 2023-02-16 18:01:49,788 DEBUG [RS:0;jenkins-hbase4:41975] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a 2023-02-16 18:01:49,788 DEBUG [RS:0;jenkins-hbase4:41975] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:41483 2023-02-16 18:01:49,788 DEBUG [RS:0;jenkins-hbase4:41975] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 18:01:49,793 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:49,793 DEBUG [RS:0;jenkins-hbase4:41975] zookeeper.ZKUtil(162): regionserver:41975-0x1005e4baa4d0001, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41975,1676570509518 2023-02-16 18:01:49,793 WARN [RS:0;jenkins-hbase4:41975] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 18:01:49,793 INFO [RS:0;jenkins-hbase4:41975] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 18:01:49,793 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41975,1676570509518] 2023-02-16 18:01:49,793 DEBUG [RS:0;jenkins-hbase4:41975] regionserver.HRegionServer(1947): logDir=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/WALs/jenkins-hbase4.apache.org,41975,1676570509518 2023-02-16 18:01:49,793 DEBUG [RS:1;jenkins-hbase4:38707] zookeeper.ZKUtil(162): regionserver:38707-0x1005e4baa4d0002, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41975,1676570509518 2023-02-16 18:01:49,794 DEBUG [RS:1;jenkins-hbase4:38707] zookeeper.ZKUtil(162): regionserver:38707-0x1005e4baa4d0002, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:49,795 DEBUG [RS:1;jenkins-hbase4:38707] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 18:01:49,796 INFO [RS:1;jenkins-hbase4:38707] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 18:01:49,796 DEBUG [RS:0;jenkins-hbase4:41975] zookeeper.ZKUtil(162): regionserver:41975-0x1005e4baa4d0001, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41975,1676570509518 2023-02-16 18:01:49,797 DEBUG [RS:0;jenkins-hbase4:41975] zookeeper.ZKUtil(162): regionserver:41975-0x1005e4baa4d0001, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:49,797 DEBUG [RS:0;jenkins-hbase4:41975] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 18:01:49,798 INFO [RS:0;jenkins-hbase4:41975] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 18:01:49,800 INFO [RS:1;jenkins-hbase4:38707] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 18:01:49,803 INFO [RS:0;jenkins-hbase4:41975] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 18:01:49,803 INFO [RS:1;jenkins-hbase4:38707] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 18:01:49,803 INFO [RS:1;jenkins-hbase4:38707] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:49,803 INFO [RS:0;jenkins-hbase4:41975] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 18:01:49,803 INFO [RS:0;jenkins-hbase4:41975] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:49,803 INFO [RS:1;jenkins-hbase4:38707] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 18:01:49,806 INFO [RS:0;jenkins-hbase4:41975] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 18:01:49,807 INFO [RS:0;jenkins-hbase4:41975] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:49,807 INFO [RS:1;jenkins-hbase4:38707] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:49,807 DEBUG [RS:0;jenkins-hbase4:41975] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:49,808 DEBUG [RS:1;jenkins-hbase4:38707] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:49,808 DEBUG [RS:0;jenkins-hbase4:41975] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:49,808 DEBUG [RS:1;jenkins-hbase4:38707] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:49,808 DEBUG [RS:0;jenkins-hbase4:41975] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:49,808 DEBUG [RS:1;jenkins-hbase4:38707] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:49,808 DEBUG [RS:0;jenkins-hbase4:41975] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:49,808 DEBUG [RS:1;jenkins-hbase4:38707] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:49,808 DEBUG [RS:0;jenkins-hbase4:41975] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:49,808 DEBUG [RS:1;jenkins-hbase4:38707] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:49,808 DEBUG [RS:0;jenkins-hbase4:41975] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 18:01:49,808 DEBUG [RS:1;jenkins-hbase4:38707] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 18:01:49,808 DEBUG [RS:0;jenkins-hbase4:41975] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:49,808 DEBUG [RS:1;jenkins-hbase4:38707] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:49,808 DEBUG [RS:0;jenkins-hbase4:41975] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:49,808 DEBUG [RS:1;jenkins-hbase4:38707] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:49,809 DEBUG [RS:0;jenkins-hbase4:41975] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:49,809 DEBUG [RS:1;jenkins-hbase4:38707] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:49,809 DEBUG [RS:0;jenkins-hbase4:41975] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:49,809 DEBUG [RS:1;jenkins-hbase4:38707] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:49,811 INFO [RS:0;jenkins-hbase4:41975] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:49,811 INFO [RS:0;jenkins-hbase4:41975] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:49,811 INFO [RS:0;jenkins-hbase4:41975] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:49,811 INFO [RS:1;jenkins-hbase4:38707] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:49,811 INFO [RS:1;jenkins-hbase4:38707] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:49,811 INFO [RS:1;jenkins-hbase4:38707] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:49,822 INFO [RS:0;jenkins-hbase4:41975] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 18:01:49,823 INFO [RS:0;jenkins-hbase4:41975] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41975,1676570509518-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:49,826 INFO [RS:1;jenkins-hbase4:38707] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 18:01:49,826 INFO [RS:1;jenkins-hbase4:38707] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38707,1676570509543-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:49,835 INFO [RS:0;jenkins-hbase4:41975] regionserver.Replication(203): jenkins-hbase4.apache.org,41975,1676570509518 started 2023-02-16 18:01:49,835 INFO [RS:0;jenkins-hbase4:41975] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,41975,1676570509518, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41975, sessionid=0x1005e4baa4d0001 2023-02-16 18:01:49,835 DEBUG [RS:0;jenkins-hbase4:41975] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 18:01:49,835 DEBUG [RS:0;jenkins-hbase4:41975] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41975,1676570509518 2023-02-16 18:01:49,835 DEBUG [RS:0;jenkins-hbase4:41975] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41975,1676570509518' 2023-02-16 18:01:49,835 DEBUG [RS:0;jenkins-hbase4:41975] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:49,836 DEBUG [RS:0;jenkins-hbase4:41975] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:49,836 DEBUG [RS:0;jenkins-hbase4:41975] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 18:01:49,836 DEBUG [RS:0;jenkins-hbase4:41975] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 18:01:49,836 DEBUG [RS:0;jenkins-hbase4:41975] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41975,1676570509518 2023-02-16 18:01:49,836 DEBUG [RS:0;jenkins-hbase4:41975] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41975,1676570509518' 2023-02-16 18:01:49,836 DEBUG [RS:0;jenkins-hbase4:41975] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:49,836 DEBUG [RS:0;jenkins-hbase4:41975] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:49,837 DEBUG [RS:0;jenkins-hbase4:41975] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 18:01:49,837 INFO [RS:0;jenkins-hbase4:41975] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 18:01:49,837 INFO [RS:0;jenkins-hbase4:41975] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 18:01:49,838 INFO [RS:1;jenkins-hbase4:38707] regionserver.Replication(203): jenkins-hbase4.apache.org,38707,1676570509543 started 2023-02-16 18:01:49,838 INFO [RS:1;jenkins-hbase4:38707] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38707,1676570509543, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38707, sessionid=0x1005e4baa4d0002 2023-02-16 18:01:49,838 DEBUG [RS:1;jenkins-hbase4:38707] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 18:01:49,838 DEBUG [RS:1;jenkins-hbase4:38707] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:49,838 DEBUG [RS:1;jenkins-hbase4:38707] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38707,1676570509543' 2023-02-16 18:01:49,838 DEBUG [RS:1;jenkins-hbase4:38707] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:49,839 DEBUG [RS:1;jenkins-hbase4:38707] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:49,839 DEBUG [RS:1;jenkins-hbase4:38707] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 18:01:49,839 DEBUG [RS:1;jenkins-hbase4:38707] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 18:01:49,839 DEBUG [RS:1;jenkins-hbase4:38707] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:49,839 DEBUG [RS:1;jenkins-hbase4:38707] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38707,1676570509543' 2023-02-16 18:01:49,839 DEBUG [RS:1;jenkins-hbase4:38707] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:49,840 DEBUG [RS:1;jenkins-hbase4:38707] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:49,840 DEBUG [RS:1;jenkins-hbase4:38707] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 18:01:49,840 INFO [RS:1;jenkins-hbase4:38707] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 18:01:49,840 INFO [RS:1;jenkins-hbase4:38707] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 18:01:49,890 DEBUG [jenkins-hbase4:43375] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-16 18:01:49,890 DEBUG [jenkins-hbase4:43375] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 18:01:49,891 DEBUG [jenkins-hbase4:43375] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 18:01:49,891 DEBUG [jenkins-hbase4:43375] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 18:01:49,891 DEBUG [jenkins-hbase4:43375] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 18:01:49,892 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38707,1676570509543, state=OPENING 2023-02-16 18:01:49,893 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-16 18:01:49,894 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:49,894 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 18:01:49,895 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38707,1676570509543}] 2023-02-16 18:01:50,049 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:50,049 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 18:01:50,051 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49700, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 18:01:50,056 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-16 18:01:50,056 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 18:01:50,058 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38707%2C1676570509543.meta, suffix=.meta, logDir=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/WALs/jenkins-hbase4.apache.org,38707,1676570509543, archiveDir=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/oldWALs, maxLogs=32 2023-02-16 18:01:50,074 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32857,DS-3e4e5de8-6fc2-4c41-869e-66648bb9ad0c,DISK] 2023-02-16 18:01:50,074 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39631,DS-6a8bac80-480a-49bf-9247-3d9c131e0e67,DISK] 2023-02-16 18:01:50,075 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/WALs/jenkins-hbase4.apache.org,38707,1676570509543/jenkins-hbase4.apache.org%2C38707%2C1676570509543.meta.1676570510058.meta 2023-02-16 18:01:50,076 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:32857,DS-3e4e5de8-6fc2-4c41-869e-66648bb9ad0c,DISK], DatanodeInfoWithStorage[127.0.0.1:39631,DS-6a8bac80-480a-49bf-9247-3d9c131e0e67,DISK]] 2023-02-16 18:01:50,076 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-16 18:01:50,076 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-16 18:01:50,076 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-16 18:01:50,076 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-16 18:01:50,076 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-16 18:01:50,076 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:50,077 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-16 18:01:50,077 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-16 18:01:50,078 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 18:01:50,079 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/hbase/meta/1588230740/info 2023-02-16 18:01:50,079 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/hbase/meta/1588230740/info 2023-02-16 18:01:50,079 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 18:01:50,080 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:50,080 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 18:01:50,081 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/hbase/meta/1588230740/rep_barrier 2023-02-16 18:01:50,081 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/hbase/meta/1588230740/rep_barrier 2023-02-16 18:01:50,082 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 18:01:50,082 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:50,082 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 18:01:50,083 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/hbase/meta/1588230740/table 2023-02-16 18:01:50,083 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/hbase/meta/1588230740/table 2023-02-16 18:01:50,083 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 18:01:50,084 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:50,084 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/hbase/meta/1588230740 2023-02-16 18:01:50,085 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/hbase/meta/1588230740 2023-02-16 18:01:50,088 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 18:01:50,089 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 18:01:50,090 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75320330, jitterRate=0.12236037850379944}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 18:01:50,090 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 18:01:50,091 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676570510049 2023-02-16 18:01:50,097 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-16 18:01:50,098 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-16 18:01:50,098 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38707,1676570509543, state=OPEN 2023-02-16 18:01:50,099 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-16 18:01:50,099 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 18:01:50,100 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-16 18:01:50,100 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38707,1676570509543 in 205 msec 2023-02-16 18:01:50,101 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-16 18:01:50,101 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 364 msec 2023-02-16 18:01:50,103 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 414 msec 2023-02-16 18:01:50,103 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676570510103, completionTime=-1 2023-02-16 18:01:50,103 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-16 18:01:50,103 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-16 18:01:50,104 DEBUG [hconnection-0x3c5cfbe4-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 18:01:50,105 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49704, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 18:01:50,107 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-16 18:01:50,107 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676570570107 2023-02-16 18:01:50,107 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676570630107 2023-02-16 18:01:50,107 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-16 18:01:50,117 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43375,1676570509471-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:50,117 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43375,1676570509471-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:50,117 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43375,1676570509471-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:50,117 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:43375, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:50,117 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:50,117 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-16 18:01:50,117 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 18:01:50,118 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-16 18:01:50,118 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-16 18:01:50,119 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 18:01:50,120 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 18:01:50,121 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/.tmp/data/hbase/namespace/620fc90c4471693f9dbfd60e06834a28 2023-02-16 18:01:50,121 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/.tmp/data/hbase/namespace/620fc90c4471693f9dbfd60e06834a28 empty. 2023-02-16 18:01:50,122 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/.tmp/data/hbase/namespace/620fc90c4471693f9dbfd60e06834a28 2023-02-16 18:01:50,122 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-16 18:01:50,129 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-16 18:01:50,130 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 620fc90c4471693f9dbfd60e06834a28, NAME => 'hbase:namespace,,1676570510117.620fc90c4471693f9dbfd60e06834a28.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/.tmp 2023-02-16 18:01:50,135 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676570510117.620fc90c4471693f9dbfd60e06834a28.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:50,135 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 620fc90c4471693f9dbfd60e06834a28, disabling compactions & flushes 2023-02-16 18:01:50,135 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676570510117.620fc90c4471693f9dbfd60e06834a28. 2023-02-16 18:01:50,135 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676570510117.620fc90c4471693f9dbfd60e06834a28. 2023-02-16 18:01:50,135 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676570510117.620fc90c4471693f9dbfd60e06834a28. after waiting 0 ms 2023-02-16 18:01:50,135 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676570510117.620fc90c4471693f9dbfd60e06834a28. 2023-02-16 18:01:50,135 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676570510117.620fc90c4471693f9dbfd60e06834a28. 2023-02-16 18:01:50,135 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 620fc90c4471693f9dbfd60e06834a28: 2023-02-16 18:01:50,137 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 18:01:50,138 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676570510117.620fc90c4471693f9dbfd60e06834a28.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676570510137"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570510137"}]},"ts":"1676570510137"} 2023-02-16 18:01:50,139 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 18:01:50,139 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 18:01:50,139 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676570510139"}]},"ts":"1676570510139"} 2023-02-16 18:01:50,140 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-16 18:01:50,143 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 18:01:50,143 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 18:01:50,143 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 18:01:50,143 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 18:01:50,143 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=620fc90c4471693f9dbfd60e06834a28, ASSIGN}] 2023-02-16 18:01:50,145 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=620fc90c4471693f9dbfd60e06834a28, ASSIGN 2023-02-16 18:01:50,146 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=620fc90c4471693f9dbfd60e06834a28, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38707,1676570509543; forceNewPlan=false, retain=false 2023-02-16 18:01:50,296 INFO [jenkins-hbase4:43375] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 18:01:50,296 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=620fc90c4471693f9dbfd60e06834a28, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:50,297 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676570510117.620fc90c4471693f9dbfd60e06834a28.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676570510296"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570510296"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570510296"}]},"ts":"1676570510296"} 2023-02-16 18:01:50,298 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 620fc90c4471693f9dbfd60e06834a28, server=jenkins-hbase4.apache.org,38707,1676570509543}] 2023-02-16 18:01:50,453 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676570510117.620fc90c4471693f9dbfd60e06834a28. 2023-02-16 18:01:50,455 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38707%2C1676570509543, suffix=, logDir=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/WALs/jenkins-hbase4.apache.org,38707,1676570509543, archiveDir=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/oldWALs, maxLogs=32 2023-02-16 18:01:50,470 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32857,DS-3e4e5de8-6fc2-4c41-869e-66648bb9ad0c,DISK] 2023-02-16 18:01:50,470 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39631,DS-6a8bac80-480a-49bf-9247-3d9c131e0e67,DISK] 2023-02-16 18:01:50,472 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/WALs/jenkins-hbase4.apache.org,38707,1676570509543/jenkins-hbase4.apache.org%2C38707%2C1676570509543.1676570510455 2023-02-16 18:01:50,472 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:32857,DS-3e4e5de8-6fc2-4c41-869e-66648bb9ad0c,DISK], DatanodeInfoWithStorage[127.0.0.1:39631,DS-6a8bac80-480a-49bf-9247-3d9c131e0e67,DISK]] 2023-02-16 18:01:50,472 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 620fc90c4471693f9dbfd60e06834a28, NAME => 'hbase:namespace,,1676570510117.620fc90c4471693f9dbfd60e06834a28.', STARTKEY => '', ENDKEY => ''} 2023-02-16 18:01:50,473 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 620fc90c4471693f9dbfd60e06834a28 2023-02-16 18:01:50,475 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676570510117.620fc90c4471693f9dbfd60e06834a28.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:50,475 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 620fc90c4471693f9dbfd60e06834a28 2023-02-16 18:01:50,475 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 620fc90c4471693f9dbfd60e06834a28 2023-02-16 18:01:50,477 INFO [StoreOpener-620fc90c4471693f9dbfd60e06834a28-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 620fc90c4471693f9dbfd60e06834a28 2023-02-16 18:01:50,478 DEBUG [StoreOpener-620fc90c4471693f9dbfd60e06834a28-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/hbase/namespace/620fc90c4471693f9dbfd60e06834a28/info 2023-02-16 18:01:50,478 DEBUG [StoreOpener-620fc90c4471693f9dbfd60e06834a28-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/hbase/namespace/620fc90c4471693f9dbfd60e06834a28/info 2023-02-16 18:01:50,478 INFO [StoreOpener-620fc90c4471693f9dbfd60e06834a28-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 620fc90c4471693f9dbfd60e06834a28 columnFamilyName info 2023-02-16 18:01:50,478 INFO [StoreOpener-620fc90c4471693f9dbfd60e06834a28-1] regionserver.HStore(310): Store=620fc90c4471693f9dbfd60e06834a28/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:50,479 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/hbase/namespace/620fc90c4471693f9dbfd60e06834a28 2023-02-16 18:01:50,479 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/hbase/namespace/620fc90c4471693f9dbfd60e06834a28 2023-02-16 18:01:50,481 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 620fc90c4471693f9dbfd60e06834a28 2023-02-16 18:01:50,483 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/hbase/namespace/620fc90c4471693f9dbfd60e06834a28/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:50,483 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 620fc90c4471693f9dbfd60e06834a28; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73884693, jitterRate=0.10096772015094757}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 18:01:50,483 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 620fc90c4471693f9dbfd60e06834a28: 2023-02-16 18:01:50,484 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676570510117.620fc90c4471693f9dbfd60e06834a28., pid=6, masterSystemTime=1676570510450 2023-02-16 18:01:50,487 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676570510117.620fc90c4471693f9dbfd60e06834a28. 2023-02-16 18:01:50,487 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676570510117.620fc90c4471693f9dbfd60e06834a28. 2023-02-16 18:01:50,487 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=620fc90c4471693f9dbfd60e06834a28, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:50,487 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676570510117.620fc90c4471693f9dbfd60e06834a28.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676570510487"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676570510487"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676570510487"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676570510487"}]},"ts":"1676570510487"} 2023-02-16 18:01:50,490 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-16 18:01:50,490 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 620fc90c4471693f9dbfd60e06834a28, server=jenkins-hbase4.apache.org,38707,1676570509543 in 190 msec 2023-02-16 18:01:50,543 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-16 18:01:50,543 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=620fc90c4471693f9dbfd60e06834a28, ASSIGN in 347 msec 2023-02-16 18:01:50,544 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 18:01:50,544 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676570510544"}]},"ts":"1676570510544"} 2023-02-16 18:01:50,546 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-16 18:01:50,549 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 18:01:50,550 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 432 msec 2023-02-16 18:01:50,639 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-16 18:01:50,641 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-16 18:01:50,641 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:50,645 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-16 18:01:50,653 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 18:01:50,657 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-02-16 18:01:50,667 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-16 18:01:50,677 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 18:01:50,680 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 13 msec 2023-02-16 18:01:50,691 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-16 18:01:50,694 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-16 18:01:50,694 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.124sec 2023-02-16 18:01:50,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-16 18:01:50,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-16 18:01:50,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-16 18:01:50,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43375,1676570509471-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-16 18:01:50,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43375,1676570509471-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-16 18:01:50,696 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-16 18:01:50,762 DEBUG [Listener at localhost/38001] zookeeper.ReadOnlyZKClient(139): Connect 0x2ed93e72 to 127.0.0.1:52063 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 18:01:50,765 DEBUG [Listener at localhost/38001] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47e1584f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 18:01:50,768 DEBUG [hconnection-0x1846ffc4-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 18:01:50,770 INFO [RS-EventLoopGroup-20-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49706, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 18:01:50,771 INFO [Listener at localhost/38001] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,43375,1676570509471 2023-02-16 18:01:50,771 DEBUG [Listener at localhost/38001] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-16 18:01:50,776 DEBUG [Listener at localhost/38001] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-16 18:01:50,778 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33218, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-16 18:01:50,779 INFO [Listener at localhost/38001] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:50,779 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:50,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-16 18:01:50,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 105 connection: 172.31.14.131:33218 deadline: 1676570570779, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:50,780 INFO [Listener at localhost/38001] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-16 18:01:50,784 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 18:01:50,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:50,786 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 18:01:50,786 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-16 18:01:50,786 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 18:01:50,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 18:01:50,788 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4 2023-02-16 18:01:50,788 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4 empty. 2023-02-16 18:01:50,789 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4 2023-02-16 18:01:50,789 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-16 18:01:50,811 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-16 18:01:50,812 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => 751fbb369b6632eae03600b6b272d1f4, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/.tmp 2023-02-16 18:01:50,821 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:50,821 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing 751fbb369b6632eae03600b6b272d1f4, disabling compactions & flushes 2023-02-16 18:01:50,822 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4. 2023-02-16 18:01:50,822 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4. 2023-02-16 18:01:50,822 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4. after waiting 0 ms 2023-02-16 18:01:50,822 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4. 2023-02-16 18:01:50,822 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4. 2023-02-16 18:01:50,822 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for 751fbb369b6632eae03600b6b272d1f4: 2023-02-16 18:01:50,824 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 18:01:50,825 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676570510825"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570510825"}]},"ts":"1676570510825"} 2023-02-16 18:01:50,827 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 18:01:50,827 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 18:01:50,828 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676570510827"}]},"ts":"1676570510827"} 2023-02-16 18:01:50,829 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-16 18:01:50,832 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 18:01:50,833 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 18:01:50,833 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 18:01:50,833 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 18:01:50,834 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=751fbb369b6632eae03600b6b272d1f4, ASSIGN}] 2023-02-16 18:01:50,835 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=751fbb369b6632eae03600b6b272d1f4, ASSIGN 2023-02-16 18:01:50,836 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=751fbb369b6632eae03600b6b272d1f4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38707,1676570509543; forceNewPlan=false, retain=false 2023-02-16 18:01:50,838 INFO [RS:0;jenkins-hbase4:41975] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41975%2C1676570509518, suffix=, logDir=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/WALs/jenkins-hbase4.apache.org,41975,1676570509518, archiveDir=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/oldWALs, maxLogs=32 2023-02-16 18:01:50,853 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39631,DS-6a8bac80-480a-49bf-9247-3d9c131e0e67,DISK] 2023-02-16 18:01:50,853 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32857,DS-3e4e5de8-6fc2-4c41-869e-66648bb9ad0c,DISK] 2023-02-16 18:01:50,855 INFO [RS:0;jenkins-hbase4:41975] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/WALs/jenkins-hbase4.apache.org,41975,1676570509518/jenkins-hbase4.apache.org%2C41975%2C1676570509518.1676570510838 2023-02-16 18:01:50,855 DEBUG [RS:0;jenkins-hbase4:41975] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:32857,DS-3e4e5de8-6fc2-4c41-869e-66648bb9ad0c,DISK], DatanodeInfoWithStorage[127.0.0.1:39631,DS-6a8bac80-480a-49bf-9247-3d9c131e0e67,DISK]] 2023-02-16 18:01:50,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 18:01:50,986 INFO [jenkins-hbase4:43375] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 18:01:50,986 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=751fbb369b6632eae03600b6b272d1f4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:50,987 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676570510986"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570510986"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570510986"}]},"ts":"1676570510986"} 2023-02-16 18:01:50,989 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 751fbb369b6632eae03600b6b272d1f4, server=jenkins-hbase4.apache.org,38707,1676570509543}] 2023-02-16 18:01:51,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 18:01:51,143 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4. 2023-02-16 18:01:51,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 751fbb369b6632eae03600b6b272d1f4, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4.', STARTKEY => '', ENDKEY => ''} 2023-02-16 18:01:51,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks 751fbb369b6632eae03600b6b272d1f4 2023-02-16 18:01:51,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:51,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 751fbb369b6632eae03600b6b272d1f4 2023-02-16 18:01:51,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 751fbb369b6632eae03600b6b272d1f4 2023-02-16 18:01:51,144 INFO [StoreOpener-751fbb369b6632eae03600b6b272d1f4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 751fbb369b6632eae03600b6b272d1f4 2023-02-16 18:01:51,145 DEBUG [StoreOpener-751fbb369b6632eae03600b6b272d1f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/f1 2023-02-16 18:01:51,145 DEBUG [StoreOpener-751fbb369b6632eae03600b6b272d1f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/f1 2023-02-16 18:01:51,146 INFO [StoreOpener-751fbb369b6632eae03600b6b272d1f4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 751fbb369b6632eae03600b6b272d1f4 columnFamilyName f1 2023-02-16 18:01:51,146 INFO [StoreOpener-751fbb369b6632eae03600b6b272d1f4-1] regionserver.HStore(310): Store=751fbb369b6632eae03600b6b272d1f4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:51,146 INFO [StoreOpener-751fbb369b6632eae03600b6b272d1f4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 751fbb369b6632eae03600b6b272d1f4 2023-02-16 18:01:51,147 DEBUG [StoreOpener-751fbb369b6632eae03600b6b272d1f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/f2 2023-02-16 18:01:51,147 DEBUG [StoreOpener-751fbb369b6632eae03600b6b272d1f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/f2 2023-02-16 18:01:51,147 INFO [StoreOpener-751fbb369b6632eae03600b6b272d1f4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 751fbb369b6632eae03600b6b272d1f4 columnFamilyName f2 2023-02-16 18:01:51,148 INFO [StoreOpener-751fbb369b6632eae03600b6b272d1f4-1] regionserver.HStore(310): Store=751fbb369b6632eae03600b6b272d1f4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:51,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4 2023-02-16 18:01:51,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4 2023-02-16 18:01:51,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:51,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 751fbb369b6632eae03600b6b272d1f4 2023-02-16 18:01:51,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:51,152 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 751fbb369b6632eae03600b6b272d1f4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66125990, jitterRate=-0.014645963907241821}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:51,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 751fbb369b6632eae03600b6b272d1f4: 2023-02-16 18:01:51,153 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4., pid=12, masterSystemTime=1676570511140 2023-02-16 18:01:51,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4. 2023-02-16 18:01:51,154 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4. 2023-02-16 18:01:51,154 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=751fbb369b6632eae03600b6b272d1f4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:51,154 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676570511154"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676570511154"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676570511154"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676570511154"}]},"ts":"1676570511154"} 2023-02-16 18:01:51,157 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-16 18:01:51,157 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 751fbb369b6632eae03600b6b272d1f4, server=jenkins-hbase4.apache.org,38707,1676570509543 in 167 msec 2023-02-16 18:01:51,158 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-16 18:01:51,158 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=751fbb369b6632eae03600b6b272d1f4, ASSIGN in 324 msec 2023-02-16 18:01:51,158 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 18:01:51,158 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676570511158"}]},"ts":"1676570511158"} 2023-02-16 18:01:51,159 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-16 18:01:51,161 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 18:01:51,162 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 377 msec 2023-02-16 18:01:51,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 18:01:51,391 INFO [Listener at localhost/38001] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-16 18:01:51,391 DEBUG [Listener at localhost/38001] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-16 18:01:51,392 INFO [Listener at localhost/38001] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 18:01:51,393 INFO [Listener at localhost/38001] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-16 18:01:51,393 INFO [Listener at localhost/38001] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 18:01:51,393 INFO [Listener at localhost/38001] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-16 18:01:51,394 INFO [Listener at localhost/38001] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-16 18:01:51,423 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38707] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4. 2023-02-16 18:01:51,514 INFO [Listener at localhost/38001] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-16 18:01:51,514 INFO [Listener at localhost/38001] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-16 18:01:51,515 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-16 18:01:51,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676570511515 (current time:1676570511515). 2023-02-16 18:01:51,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-16 18:01:51,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] zookeeper.ReadOnlyZKClient(139): Connect 0x0a96f78f to 127.0.0.1:52063 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 18:01:51,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5acb76ca, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 18:01:51,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 18:01:51,521 INFO [RS-EventLoopGroup-20-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49708, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 18:01:51,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a96f78f to 127.0.0.1:52063 2023-02-16 18:01:51,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:51,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-16 18:01:51,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-16 18:01:51,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-16 18:01:51,525 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-16 18:01:51,525 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1676571111525 2023-02-16 18:01:51,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-16 18:01:51,525 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:51,526 DEBUG [Listener at localhost/38001] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-16 18:01:51,527 DEBUG [Listener at localhost/38001] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-16 18:01:51,527 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-16 18:01:51,527 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-16 18:01:51,528 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 4 msec 2023-02-16 18:01:51,529 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-16 18:01:51,529 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1676571111529 2023-02-16 18:01:51,535 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-16 18:01:51,536 INFO [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-16 18:01:51,536 DEBUG [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 18:01:51,536 DEBUG [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-16 18:01:51,536 DEBUG [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-16 18:01:51,537 DEBUG [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-16 18:01:51,537 DEBUG [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-16 18:01:51,538 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): regionserver:41975-0x1005e4baa4d0001, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 18:01:51,538 DEBUG [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:51,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 18:01:51,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:51,538 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): regionserver:38707-0x1005e4baa4d0002, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 18:01:51,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 18:01:51,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:51,538 DEBUG [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:51,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-16 18:01:51,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-16 18:01:51,538 DEBUG [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 18:01:51,539 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41975-0x1005e4baa4d0001, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-16 18:01:51,539 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38707-0x1005e4baa4d0002, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-16 18:01:51,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-16 18:01:51,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-16 18:01:51,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-16 18:01:51,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-16 18:01:51,539 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-16 18:01:51,539 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-16 18:01:51,539 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-16 18:01:51,539 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-16 18:01:51,539 DEBUG [member: 'jenkins-hbase4.apache.org,38707,1676570509543' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-16 18:01:51,539 DEBUG [member: 'jenkins-hbase4.apache.org,38707,1676570509543' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 18:01:51,539 DEBUG [member: 'jenkins-hbase4.apache.org,41975,1676570509518' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-16 18:01:51,540 DEBUG [member: 'jenkins-hbase4.apache.org,41975,1676570509518' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 18:01:51,540 DEBUG [member: 'jenkins-hbase4.apache.org,38707,1676570509543' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-16 18:01:51,541 DEBUG [member: 'jenkins-hbase4.apache.org,41975,1676570509518' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-16 18:01:51,541 DEBUG [member: 'jenkins-hbase4.apache.org,38707,1676570509543' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-16 18:01:51,541 DEBUG [member: 'jenkins-hbase4.apache.org,38707,1676570509543' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38707,1676570509543' joining acquired barrier for procedure (foo) in zk 2023-02-16 18:01:51,541 DEBUG [member: 'jenkins-hbase4.apache.org,41975,1676570509518' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-16 18:01:51,541 DEBUG [member: 'jenkins-hbase4.apache.org,41975,1676570509518' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41975,1676570509518' joining acquired barrier for procedure (foo) in zk 2023-02-16 18:01:51,542 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:51,542 DEBUG [member: 'jenkins-hbase4.apache.org,41975,1676570509518' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-16 18:01:51,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:51,542 DEBUG [member: 'jenkins-hbase4.apache.org,38707,1676570509543' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-16 18:01:51,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:51,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 18:01:51,542 DEBUG [member: 'jenkins-hbase4.apache.org,41975,1676570509518' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41975-0x1005e4baa4d0001, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-16 18:01:51,542 DEBUG [member: 'jenkins-hbase4.apache.org,41975,1676570509518' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 18:01:51,542 DEBUG [member: 'jenkins-hbase4.apache.org,38707,1676570509543' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38707-0x1005e4baa4d0002, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-16 18:01:51,542 DEBUG [member: 'jenkins-hbase4.apache.org,38707,1676570509543' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 18:01:51,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:51,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:51,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 18:01:51,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41975,1676570509518 2023-02-16 18:01:51,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:51,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:51,544 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38707,1676570509543' joining acquired barrier for procedure 'foo' on coordinator 2023-02-16 18:01:51,544 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77d320ba[Count = 0] remaining members to acquire global barrier 2023-02-16 18:01:51,544 DEBUG [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-16 18:01:51,544 DEBUG [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-16 18:01:51,545 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): regionserver:38707-0x1005e4baa4d0002, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-16 18:01:51,545 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): regionserver:41975-0x1005e4baa4d0001, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-16 18:01:51,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-16 18:01:51,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-16 18:01:51,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-16 18:01:51,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-16 18:01:51,545 DEBUG [member: 'jenkins-hbase4.apache.org,38707,1676570509543' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-16 18:01:51,545 DEBUG [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:51,545 DEBUG [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 18:01:51,545 DEBUG [member: 'jenkins-hbase4.apache.org,41975,1676570509518' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-16 18:01:51,545 DEBUG [member: 'jenkins-hbase4.apache.org,41975,1676570509518' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-16 18:01:51,545 DEBUG [member: 'jenkins-hbase4.apache.org,38707,1676570509543' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-16 18:01:51,545 DEBUG [member: 'jenkins-hbase4.apache.org,38707,1676570509543' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 18:01:51,545 DEBUG [rs(jenkins-hbase4.apache.org,38707,1676570509543)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4. 2023-02-16 18:01:51,545 DEBUG [member: 'jenkins-hbase4.apache.org,41975,1676570509518' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,41975,1676570509518' in zk 2023-02-16 18:01:51,546 DEBUG [rs(jenkins-hbase4.apache.org,38707,1676570509543)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4. started... 2023-02-16 18:01:51,546 INFO [rs(jenkins-hbase4.apache.org,38707,1676570509543)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 751fbb369b6632eae03600b6b272d1f4 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-16 18:01:51,548 DEBUG [member: 'jenkins-hbase4.apache.org,41975,1676570509518' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-16 18:01:51,548 DEBUG [member: 'jenkins-hbase4.apache.org,41975,1676570509518' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:51,548 DEBUG [member: 'jenkins-hbase4.apache.org,41975,1676570509518' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-16 18:01:51,560 INFO [rs(jenkins-hbase4.apache.org,38707,1676570509543)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/.tmp/f1/ed055a34107a4b288c35d0c336d3f1d6 2023-02-16 18:01:51,575 INFO [rs(jenkins-hbase4.apache.org,38707,1676570509543)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/.tmp/f2/210ae853356545a7bea56885eab0e6a2 2023-02-16 18:01:51,578 DEBUG [rs(jenkins-hbase4.apache.org,38707,1676570509543)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/.tmp/f1/ed055a34107a4b288c35d0c336d3f1d6 as hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/f1/ed055a34107a4b288c35d0c336d3f1d6 2023-02-16 18:01:51,582 INFO [rs(jenkins-hbase4.apache.org,38707,1676570509543)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/f1/ed055a34107a4b288c35d0c336d3f1d6, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-16 18:01:51,582 DEBUG [rs(jenkins-hbase4.apache.org,38707,1676570509543)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/.tmp/f2/210ae853356545a7bea56885eab0e6a2 as hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/f2/210ae853356545a7bea56885eab0e6a2 2023-02-16 18:01:51,585 INFO [rs(jenkins-hbase4.apache.org,38707,1676570509543)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/f2/210ae853356545a7bea56885eab0e6a2, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-16 18:01:51,586 INFO [rs(jenkins-hbase4.apache.org,38707,1676570509543)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 751fbb369b6632eae03600b6b272d1f4 in 40ms, sequenceid=5, compaction requested=false 2023-02-16 18:01:51,586 DEBUG [rs(jenkins-hbase4.apache.org,38707,1676570509543)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-16 18:01:51,586 DEBUG [rs(jenkins-hbase4.apache.org,38707,1676570509543)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 751fbb369b6632eae03600b6b272d1f4: 2023-02-16 18:01:51,587 DEBUG [rs(jenkins-hbase4.apache.org,38707,1676570509543)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4.' region-info for snapshot=foo 2023-02-16 18:01:51,587 DEBUG [rs(jenkins-hbase4.apache.org,38707,1676570509543)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 18:01:51,587 DEBUG [rs(jenkins-hbase4.apache.org,38707,1676570509543)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/f1/ed055a34107a4b288c35d0c336d3f1d6] hfiles 2023-02-16 18:01:51,587 DEBUG [rs(jenkins-hbase4.apache.org,38707,1676570509543)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/f1/ed055a34107a4b288c35d0c336d3f1d6 for snapshot=foo 2023-02-16 18:01:51,587 DEBUG [rs(jenkins-hbase4.apache.org,38707,1676570509543)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/f2/210ae853356545a7bea56885eab0e6a2] hfiles 2023-02-16 18:01:51,587 DEBUG [rs(jenkins-hbase4.apache.org,38707,1676570509543)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/f2/210ae853356545a7bea56885eab0e6a2 for snapshot=foo 2023-02-16 18:01:51,592 DEBUG [rs(jenkins-hbase4.apache.org,38707,1676570509543)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4. completed. 2023-02-16 18:01:51,592 DEBUG [rs(jenkins-hbase4.apache.org,38707,1676570509543)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4. 2023-02-16 18:01:51,592 DEBUG [member: 'jenkins-hbase4.apache.org,38707,1676570509543' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-16 18:01:51,592 DEBUG [member: 'jenkins-hbase4.apache.org,38707,1676570509543' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-16 18:01:51,592 DEBUG [member: 'jenkins-hbase4.apache.org,38707,1676570509543' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:51,592 DEBUG [member: 'jenkins-hbase4.apache.org,38707,1676570509543' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-16 18:01:51,592 DEBUG [member: 'jenkins-hbase4.apache.org,38707,1676570509543' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,38707,1676570509543' in zk 2023-02-16 18:01:51,594 DEBUG [member: 'jenkins-hbase4.apache.org,38707,1676570509543' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-16 18:01:51,594 DEBUG [member: 'jenkins-hbase4.apache.org,38707,1676570509543' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:51,594 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:51,594 DEBUG [member: 'jenkins-hbase4.apache.org,38707,1676570509543' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-16 18:01:51,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:51,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:51,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 18:01:51,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:51,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:51,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 18:01:51,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41975,1676570509518 2023-02-16 18:01:51,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:51,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:51,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 18:01:51,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41975,1676570509518 2023-02-16 18:01:51,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:51,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,38707,1676570509543': 2023-02-16 18:01:51,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38707,1676570509543' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-16 18:01:51,597 INFO [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-16 18:01:51,597 DEBUG [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 18:01:51,597 DEBUG [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 18:01:51,597 DEBUG [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-16 18:01:51,597 INFO [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-16 18:01:51,598 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): regionserver:38707-0x1005e4baa4d0002, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-16 18:01:51,598 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): regionserver:41975-0x1005e4baa4d0001, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-16 18:01:51,598 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-16 18:01:51,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-16 18:01:51,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-16 18:01:51,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-16 18:01:51,598 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): regionserver:38707-0x1005e4baa4d0002, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 18:01:51,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-16 18:01:51,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-16 18:01:51,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:51,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 18:01:51,599 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): regionserver:41975-0x1005e4baa4d0001, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 18:01:51,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 18:01:51,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:51,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 18:01:51,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:51,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:51,599 DEBUG [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41975,1676570509518 2023-02-16 18:01:51,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-16 18:01:51,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-16 18:01:51,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 18:01:51,600 DEBUG [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:51,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:51,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 18:01:51,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41975,1676570509518 2023-02-16 18:01:51,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:51,601 DEBUG [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41975,1676570509518 2023-02-16 18:01:51,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:51,601 DEBUG [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:51,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 18:01:51,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41975,1676570509518 2023-02-16 18:01:51,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:51,610 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:51,610 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): regionserver:38707-0x1005e4baa4d0002, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 18:01:51,610 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): regionserver:41975-0x1005e4baa4d0001, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 18:01:51,610 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-16 18:01:51,610 DEBUG [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:51,610 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41975,1676570509518 2023-02-16 18:01:51,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 18:01:51,610 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): regionserver:41975-0x1005e4baa4d0001, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 18:01:51,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 18:01:51,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:51,610 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): regionserver:38707-0x1005e4baa4d0002, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 18:01:51,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:51,610 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-16 18:01:51,610 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-16 18:01:51,611 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:51,611 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-16 18:01:51,611 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-16 18:01:51,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 18:01:51,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 18:01:51,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:51,611 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41975,1676570509518 2023-02-16 18:01:51,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:51,611 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-16 18:01:51,611 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-16 18:01:51,611 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/.hbase-snapshot/.tmp/foo 2023-02-16 18:01:51,627 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/.hbase-snapshot/.tmp/foo to hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/.hbase-snapshot/foo 2023-02-16 18:01:51,627 DEBUG [Listener at localhost/38001] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 18:01:51,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-16 18:01:51,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-16 18:01:51,629 DEBUG [Listener at localhost/38001] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-16 18:01:51,670 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-16 18:01:51,670 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/.hbase-snapshot/.tmp/foo 2023-02-16 18:01:51,670 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/.hbase-snapshot/.tmp/foo 2023-02-16 18:01:51,670 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1676570511525Consolidate snapshot: foo at 1676570511611 (+86 ms)Loading Region manifests for foo at 1676570511611Writing data manifest for foo at 1676570511614 (+3 ms)Verifying snapshot: foo at 1676570511620 (+6 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1676570511670 (+50 ms) 2023-02-16 18:01:51,672 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-16 18:01:51,676 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 146 msec 2023-02-16 18:01:51,829 DEBUG [Listener at localhost/38001] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 18:01:51,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-16 18:01:51,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-16 18:01:51,831 INFO [Listener at localhost/38001] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-16 18:01:51,834 INFO [Listener at localhost/38001] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-16 18:01:51,839 INFO [Listener at localhost/38001] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-16 18:01:51,872 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38707] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4. 2023-02-16 18:01:51,960 INFO [Listener at localhost/38001] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-16 18:01:51,965 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-16 18:01:51,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:51,967 INFO [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-16 18:01:51,967 DEBUG [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 18:01:51,968 DEBUG [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-16 18:01:51,968 DEBUG [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-16 18:01:51,969 DEBUG [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:51,969 DEBUG [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:51,970 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): regionserver:38707-0x1005e4baa4d0002, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 18:01:51,970 DEBUG [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:51,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 18:01:51,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:51,970 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): regionserver:41975-0x1005e4baa4d0001, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 18:01:51,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 18:01:51,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:51,970 DEBUG [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:51,970 DEBUG [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 18:01:51,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:51,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:51,971 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38707-0x1005e4baa4d0002, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:51,971 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41975-0x1005e4baa4d0001, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:51,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 18:01:51,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:51,971 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:51,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 18:01:51,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:51,971 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:51,971 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:51,971 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:51,971 DEBUG [member: 'jenkins-hbase4.apache.org,38707,1676570509543' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-16 18:01:51,971 DEBUG [member: 'jenkins-hbase4.apache.org,38707,1676570509543' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 18:01:51,972 DEBUG [member: 'jenkins-hbase4.apache.org,38707,1676570509543' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-16 18:01:51,972 DEBUG [member: 'jenkins-hbase4.apache.org,41975,1676570509518' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-16 18:01:51,972 DEBUG [member: 'jenkins-hbase4.apache.org,41975,1676570509518' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 18:01:51,973 DEBUG [member: 'jenkins-hbase4.apache.org,38707,1676570509543' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-16 18:01:51,973 DEBUG [member: 'jenkins-hbase4.apache.org,41975,1676570509518' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-16 18:01:51,973 DEBUG [rs(jenkins-hbase4.apache.org,38707,1676570509543)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4. 2023-02-16 18:01:51,973 DEBUG [rs(jenkins-hbase4.apache.org,38707,1676570509543)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4. started... 2023-02-16 18:01:51,973 DEBUG [member: 'jenkins-hbase4.apache.org,41975,1676570509518' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-16 18:01:51,973 DEBUG [member: 'jenkins-hbase4.apache.org,38707,1676570509543' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 18:01:51,973 INFO [rs(jenkins-hbase4.apache.org,38707,1676570509543)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 751fbb369b6632eae03600b6b272d1f4 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-16 18:01:51,973 DEBUG [member: 'jenkins-hbase4.apache.org,41975,1676570509518' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41975,1676570509518' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-16 18:01:51,975 DEBUG [member: 'jenkins-hbase4.apache.org,41975,1676570509518' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:51,975 DEBUG [member: 'jenkins-hbase4.apache.org,41975,1676570509518' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41975-0x1005e4baa4d0001, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:51,975 DEBUG [member: 'jenkins-hbase4.apache.org,41975,1676570509518' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 18:01:51,988 INFO [rs(jenkins-hbase4.apache.org,38707,1676570509543)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/.tmp/f1/2fc92fcfc6fd4861b0d184ec686cb059 2023-02-16 18:01:52,006 INFO [rs(jenkins-hbase4.apache.org,38707,1676570509543)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/.tmp/f2/4a4850867f7548c0a0b15c029957d895 2023-02-16 18:01:52,010 DEBUG [rs(jenkins-hbase4.apache.org,38707,1676570509543)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/.tmp/f1/2fc92fcfc6fd4861b0d184ec686cb059 as hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/f1/2fc92fcfc6fd4861b0d184ec686cb059 2023-02-16 18:01:52,014 INFO [rs(jenkins-hbase4.apache.org,38707,1676570509543)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/f1/2fc92fcfc6fd4861b0d184ec686cb059, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-16 18:01:52,015 DEBUG [rs(jenkins-hbase4.apache.org,38707,1676570509543)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/.tmp/f2/4a4850867f7548c0a0b15c029957d895 as hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/f2/4a4850867f7548c0a0b15c029957d895 2023-02-16 18:01:52,018 INFO [rs(jenkins-hbase4.apache.org,38707,1676570509543)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/f2/4a4850867f7548c0a0b15c029957d895, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-16 18:01:52,019 INFO [rs(jenkins-hbase4.apache.org,38707,1676570509543)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 751fbb369b6632eae03600b6b272d1f4 in 46ms, sequenceid=9, compaction requested=false 2023-02-16 18:01:52,020 DEBUG [rs(jenkins-hbase4.apache.org,38707,1676570509543)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 751fbb369b6632eae03600b6b272d1f4: 2023-02-16 18:01:52,020 DEBUG [rs(jenkins-hbase4.apache.org,38707,1676570509543)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4. 2023-02-16 18:01:52,020 DEBUG [member: 'jenkins-hbase4.apache.org,38707,1676570509543' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-16 18:01:52,020 DEBUG [member: 'jenkins-hbase4.apache.org,38707,1676570509543' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-16 18:01:52,020 DEBUG [member: 'jenkins-hbase4.apache.org,38707,1676570509543' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:52,020 DEBUG [member: 'jenkins-hbase4.apache.org,38707,1676570509543' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-16 18:01:52,020 DEBUG [member: 'jenkins-hbase4.apache.org,38707,1676570509543' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38707,1676570509543' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-16 18:01:52,021 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:52,021 DEBUG [member: 'jenkins-hbase4.apache.org,38707,1676570509543' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:52,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:52,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 18:01:52,022 DEBUG [member: 'jenkins-hbase4.apache.org,38707,1676570509543' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38707-0x1005e4baa4d0002, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,022 DEBUG [member: 'jenkins-hbase4.apache.org,38707,1676570509543' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 18:01:52,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:52,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:52,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41975,1676570509518 2023-02-16 18:01:52,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:52,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:52,023 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38707,1676570509543' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-16 18:01:52,023 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73ecaa98[Count = 0] remaining members to acquire global barrier 2023-02-16 18:01:52,023 DEBUG [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-16 18:01:52,023 DEBUG [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,025 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): regionserver:38707-0x1005e4baa4d0002, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,025 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): regionserver:41975-0x1005e4baa4d0001, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,025 DEBUG [member: 'jenkins-hbase4.apache.org,41975,1676570509518' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-16 18:01:52,026 DEBUG [member: 'jenkins-hbase4.apache.org,38707,1676570509543' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-16 18:01:52,026 DEBUG [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:52,026 DEBUG [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 18:01:52,026 DEBUG [member: 'jenkins-hbase4.apache.org,38707,1676570509543' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-16 18:01:52,026 DEBUG [member: 'jenkins-hbase4.apache.org,41975,1676570509518' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-16 18:01:52,026 DEBUG [member: 'jenkins-hbase4.apache.org,41975,1676570509518' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,41975,1676570509518' in zk 2023-02-16 18:01:52,026 DEBUG [member: 'jenkins-hbase4.apache.org,38707,1676570509543' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,38707,1676570509543' in zk 2023-02-16 18:01:52,027 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:52,027 DEBUG [member: 'jenkins-hbase4.apache.org,38707,1676570509543' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-16 18:01:52,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:52,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:52,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 18:01:52,027 DEBUG [member: 'jenkins-hbase4.apache.org,38707,1676570509543' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:52,027 DEBUG [member: 'jenkins-hbase4.apache.org,38707,1676570509543' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-16 18:01:52,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:52,028 DEBUG [member: 'jenkins-hbase4.apache.org,41975,1676570509518' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-16 18:01:52,028 DEBUG [member: 'jenkins-hbase4.apache.org,41975,1676570509518' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:52,028 DEBUG [member: 'jenkins-hbase4.apache.org,41975,1676570509518' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-16 18:01:52,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:52,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41975,1676570509518 2023-02-16 18:01:52,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:52,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:52,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41975,1676570509518 2023-02-16 18:01:52,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:52,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' member 'jenkins-hbase4.apache.org,38707,1676570509543': 2023-02-16 18:01:52,030 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38707,1676570509543' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-16 18:01:52,030 INFO [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-16 18:01:52,030 DEBUG [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 18:01:52,030 DEBUG [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 18:01:52,030 DEBUG [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,030 INFO [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-16 18:01:52,032 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): regionserver:38707-0x1005e4baa4d0002, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,032 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): regionserver:41975-0x1005e4baa4d0001, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,032 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): regionserver:38707-0x1005e4baa4d0002, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 18:01:52,032 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,032 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): regionserver:41975-0x1005e4baa4d0001, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 18:01:52,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:52,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 18:01:52,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 18:01:52,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 18:01:52,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:52,032 DEBUG [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41975,1676570509518 2023-02-16 18:01:52,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:52,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:52,033 DEBUG [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:52,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:52,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41975,1676570509518 2023-02-16 18:01:52,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:52,034 DEBUG [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41975,1676570509518 2023-02-16 18:01:52,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:52,034 DEBUG [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:52,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41975,1676570509518 2023-02-16 18:01:52,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:52,038 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:52,038 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): regionserver:41975-0x1005e4baa4d0001, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 18:01:52,038 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,038 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): regionserver:41975-0x1005e4baa4d0001, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 18:01:52,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 18:01:52,038 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-16 18:01:52,038 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-16 18:01:52,038 DEBUG [(jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:52,038 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41975,1676570509518 2023-02-16 18:01:52,038 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): regionserver:38707-0x1005e4baa4d0002, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 18:01:52,038 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:52,038 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:52,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 18:01:52,038 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,038 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): regionserver:38707-0x1005e4baa4d0002, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 18:01:52,038 DEBUG [Listener at localhost/38001] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-16 18:01:52,038 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41975,1676570509518 2023-02-16 18:01:52,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 18:01:52,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:52,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:52,038 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,038 DEBUG [Listener at localhost/38001] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-16 18:01:52,039 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 18:01:52,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:52,139 DEBUG [Listener at localhost/38001] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-16 18:01:52,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-16 18:01:52,144 INFO [Listener at localhost/38001] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676570511515 type: FLUSH version: 2 ttl: 0 2023-02-16 18:01:52,144 DEBUG [Listener at localhost/38001] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:41483/user/jenkins/test-data/2bb84fc3-5066-ab2f-f1fc-5f43fa4014ec/foo/b9f533ab-e18e-42e3-9e45-31e7372799e2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,145 INFO [Listener at localhost/38001] snapshot.RestoreSnapshotHelper(239): region to add: 751fbb369b6632eae03600b6b272d1f4 2023-02-16 18:01:52,145 INFO [Listener at localhost/38001] snapshot.RestoreSnapshotHelper(585): clone region=751fbb369b6632eae03600b6b272d1f4 as 751fbb369b6632eae03600b6b272d1f4 in snapshot foo 2023-02-16 18:01:52,145 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 751fbb369b6632eae03600b6b272d1f4, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41483/user/jenkins/test-data/2bb84fc3-5066-ab2f-f1fc-5f43fa4014ec/foo/b9f533ab-e18e-42e3-9e45-31e7372799e2 2023-02-16 18:01:52,151 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:52,151 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ed055a34107a4b288c35d0c336d3f1d6 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,153 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 210ae853356545a7bea56885eab0e6a2 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,154 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 751fbb369b6632eae03600b6b272d1f4, disabling compactions & flushes 2023-02-16 18:01:52,154 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4. 2023-02-16 18:01:52,154 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4. 2023-02-16 18:01:52,154 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4. after waiting 0 ms 2023-02-16 18:01:52,154 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4. 2023-02-16 18:01:52,154 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4. 2023-02-16 18:01:52,154 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 751fbb369b6632eae03600b6b272d1f4: 2023-02-16 18:01:52,156 INFO [Listener at localhost/38001] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676570511515 type: FLUSH version: 2 ttl: 0 2023-02-16 18:01:52,156 DEBUG [Listener at localhost/38001] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:41483/user/jenkins/test-data/2bb84fc3-5066-ab2f-f1fc-5f43fa4014ec/foo/b9f533ab-e18e-42e3-9e45-31e7372799e2 2023-02-16 18:01:52,156 DEBUG [Listener at localhost/38001] util.CommonFSUtils(682): File system contents for path hdfs://localhost:41483/user/jenkins/test-data/2bb84fc3-5066-ab2f-f1fc-5f43fa4014ec/foo/b9f533ab-e18e-42e3-9e45-31e7372799e2 2023-02-16 18:01:52,156 DEBUG [Listener at localhost/38001] util.CommonFSUtils(699): |-data/ 2023-02-16 18:01:52,157 DEBUG [Listener at localhost/38001] util.CommonFSUtils(699): |----default/ 2023-02-16 18:01:52,157 DEBUG [Listener at localhost/38001] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-16 18:01:52,157 DEBUG [Listener at localhost/38001] util.CommonFSUtils(699): |----------751fbb369b6632eae03600b6b272d1f4/ 2023-02-16 18:01:52,157 DEBUG [Listener at localhost/38001] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 18:01:52,158 DEBUG [Listener at localhost/38001] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 18:01:52,158 DEBUG [Listener at localhost/38001] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=751fbb369b6632eae03600b6b272d1f4-ed055a34107a4b288c35d0c336d3f1d6 2023-02-16 18:01:52,158 DEBUG [Listener at localhost/38001] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 18:01:52,158 DEBUG [Listener at localhost/38001] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=751fbb369b6632eae03600b6b272d1f4-210ae853356545a7bea56885eab0e6a2 hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/f1/2fc92fcfc6fd4861b0d184ec686cb059 hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/f1/ed055a34107a4b288c35d0c336d3f1d6 hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/f2/210ae853356545a7bea56885eab0e6a2 hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/f2/4a4850867f7548c0a0b15c029957d895 2023-02-16 18:01:52,163 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-16 18:01:52,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-16 18:01:52,165 INFO [Listener at localhost/38001] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,166 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 18:01:52,169 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676570512169"}]},"ts":"1676570512169"} 2023-02-16 18:01:52,170 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-16 18:01:52,171 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-16 18:01:52,172 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=751fbb369b6632eae03600b6b272d1f4, UNASSIGN}] 2023-02-16 18:01:52,173 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=751fbb369b6632eae03600b6b272d1f4, UNASSIGN 2023-02-16 18:01:52,174 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=751fbb369b6632eae03600b6b272d1f4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:52,174 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676570512174"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570512174"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570512174"}]},"ts":"1676570512174"} 2023-02-16 18:01:52,175 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 751fbb369b6632eae03600b6b272d1f4, server=jenkins-hbase4.apache.org,38707,1676570509543}] 2023-02-16 18:01:52,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 18:01:52,327 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 751fbb369b6632eae03600b6b272d1f4 2023-02-16 18:01:52,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 751fbb369b6632eae03600b6b272d1f4, disabling compactions & flushes 2023-02-16 18:01:52,327 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4. 2023-02-16 18:01:52,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4. 2023-02-16 18:01:52,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4. after waiting 0 ms 2023-02-16 18:01:52,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4. 2023-02-16 18:01:52,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 18:01:52,331 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4. 2023-02-16 18:01:52,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 751fbb369b6632eae03600b6b272d1f4: 2023-02-16 18:01:52,333 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 751fbb369b6632eae03600b6b272d1f4 2023-02-16 18:01:52,333 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=751fbb369b6632eae03600b6b272d1f4, regionState=CLOSED 2023-02-16 18:01:52,333 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676570512333"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570512333"}]},"ts":"1676570512333"} 2023-02-16 18:01:52,335 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-16 18:01:52,336 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 751fbb369b6632eae03600b6b272d1f4, server=jenkins-hbase4.apache.org,38707,1676570509543 in 159 msec 2023-02-16 18:01:52,337 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-16 18:01:52,337 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=751fbb369b6632eae03600b6b272d1f4, UNASSIGN in 164 msec 2023-02-16 18:01:52,337 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676570512337"}]},"ts":"1676570512337"} 2023-02-16 18:01:52,339 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-16 18:01:52,340 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-16 18:01:52,342 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 175 msec 2023-02-16 18:01:52,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 18:01:52,476 INFO [Listener at localhost/38001] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-16 18:01:52,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,480 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,481 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-16 18:01:52,484 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4 2023-02-16 18:01:52,486 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/f1, FileablePath, hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/f2, FileablePath, hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/recovered.edits] 2023-02-16 18:01:52,490 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/f1/2fc92fcfc6fd4861b0d184ec686cb059 to hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/f1/2fc92fcfc6fd4861b0d184ec686cb059 2023-02-16 18:01:52,491 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/f1/ed055a34107a4b288c35d0c336d3f1d6 to hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/f1/ed055a34107a4b288c35d0c336d3f1d6 2023-02-16 18:01:52,494 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/f2/210ae853356545a7bea56885eab0e6a2 to hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/f2/210ae853356545a7bea56885eab0e6a2 2023-02-16 18:01:52,495 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/f2/4a4850867f7548c0a0b15c029957d895 to hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/f2/4a4850867f7548c0a0b15c029957d895 2023-02-16 18:01:52,498 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/recovered.edits/12.seqid to hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4/recovered.edits/12.seqid 2023-02-16 18:01:52,499 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/751fbb369b6632eae03600b6b272d1f4 2023-02-16 18:01:52,499 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-16 18:01:52,502 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,503 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-16 18:01:52,505 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-16 18:01:52,508 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,508 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-16 18:01:52,508 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676570512508"}]},"ts":"9223372036854775807"} 2023-02-16 18:01:52,509 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-16 18:01:52,510 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 751fbb369b6632eae03600b6b272d1f4, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676570510783.751fbb369b6632eae03600b6b272d1f4.', STARTKEY => '', ENDKEY => ''}] 2023-02-16 18:01:52,510 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-16 18:01:52,510 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676570512510"}]},"ts":"9223372036854775807"} 2023-02-16 18:01:52,511 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-16 18:01:52,514 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 18:01:52,514 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 37 msec 2023-02-16 18:01:52,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-16 18:01:52,582 INFO [Listener at localhost/38001] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-16 18:01:52,582 INFO [Listener at localhost/38001] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-16 18:01:52,583 INFO [Listener at localhost/38001] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-16 18:01:52,583 DEBUG [Listener at localhost/38001] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2ed93e72 to 127.0.0.1:52063 2023-02-16 18:01:52,583 DEBUG [Listener at localhost/38001] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:52,583 DEBUG [Listener at localhost/38001] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-16 18:01:52,583 DEBUG [Listener at localhost/38001] util.JVMClusterUtil(257): Found active master hash=1037584960, stopped=false 2023-02-16 18:01:52,583 INFO [Listener at localhost/38001] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,43375,1676570509471 2023-02-16 18:01:52,585 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): regionserver:41975-0x1005e4baa4d0001, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:52,585 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): regionserver:38707-0x1005e4baa4d0002, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:52,585 INFO [Listener at localhost/38001] procedure2.ProcedureExecutor(629): Stopping 2023-02-16 18:01:52,585 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:52,585 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:52,586 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38707-0x1005e4baa4d0002, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:52,586 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41975-0x1005e4baa4d0001, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:52,586 DEBUG [Listener at localhost/38001] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x31754d47 to 127.0.0.1:52063 2023-02-16 18:01:52,586 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:52,586 DEBUG [Listener at localhost/38001] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:52,587 INFO [Listener at localhost/38001] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41975,1676570509518' ***** 2023-02-16 18:01:52,587 INFO [Listener at localhost/38001] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 18:01:52,587 INFO [Listener at localhost/38001] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38707,1676570509543' ***** 2023-02-16 18:01:52,587 INFO [Listener at localhost/38001] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 18:01:52,587 INFO [RS:0;jenkins-hbase4:41975] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 18:01:52,587 INFO [RS:1;jenkins-hbase4:38707] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 18:01:52,587 INFO [RS:0;jenkins-hbase4:41975] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 18:01:52,587 INFO [RS:1;jenkins-hbase4:38707] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 18:01:52,587 INFO [RS:0;jenkins-hbase4:41975] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 18:01:52,587 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 18:01:52,587 INFO [RS:0;jenkins-hbase4:41975] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41975,1676570509518 2023-02-16 18:01:52,587 INFO [RS:1;jenkins-hbase4:38707] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 18:01:52,587 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 18:01:52,588 INFO [RS:1;jenkins-hbase4:38707] regionserver.HRegionServer(3304): Received CLOSE for 620fc90c4471693f9dbfd60e06834a28 2023-02-16 18:01:52,588 DEBUG [RS:0;jenkins-hbase4:41975] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x551c355c to 127.0.0.1:52063 2023-02-16 18:01:52,589 INFO [RS:1;jenkins-hbase4:38707] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:52,589 DEBUG [RS:0;jenkins-hbase4:41975] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:52,589 DEBUG [RS:1;jenkins-hbase4:38707] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f3ede3f to 127.0.0.1:52063 2023-02-16 18:01:52,589 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 620fc90c4471693f9dbfd60e06834a28, disabling compactions & flushes 2023-02-16 18:01:52,589 DEBUG [RS:1;jenkins-hbase4:38707] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:52,589 INFO [RS:0;jenkins-hbase4:41975] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41975,1676570509518; all regions closed. 2023-02-16 18:01:52,589 INFO [RS:1;jenkins-hbase4:38707] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 18:01:52,589 INFO [RS:1;jenkins-hbase4:38707] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 18:01:52,589 INFO [RS:1;jenkins-hbase4:38707] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 18:01:52,589 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676570510117.620fc90c4471693f9dbfd60e06834a28. 2023-02-16 18:01:52,589 INFO [RS:1;jenkins-hbase4:38707] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-16 18:01:52,589 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676570510117.620fc90c4471693f9dbfd60e06834a28. 2023-02-16 18:01:52,589 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676570510117.620fc90c4471693f9dbfd60e06834a28. after waiting 0 ms 2023-02-16 18:01:52,589 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676570510117.620fc90c4471693f9dbfd60e06834a28. 2023-02-16 18:01:52,589 INFO [RS:1;jenkins-hbase4:38707] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-16 18:01:52,589 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 620fc90c4471693f9dbfd60e06834a28 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-16 18:01:52,590 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 18:01:52,590 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 18:01:52,590 DEBUG [RS:1;jenkins-hbase4:38707] regionserver.HRegionServer(1479): Online Regions={620fc90c4471693f9dbfd60e06834a28=hbase:namespace,,1676570510117.620fc90c4471693f9dbfd60e06834a28., 1588230740=hbase:meta,,1.1588230740} 2023-02-16 18:01:52,590 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 18:01:52,590 DEBUG [RS:1;jenkins-hbase4:38707] regionserver.HRegionServer(1505): Waiting on 1588230740, 620fc90c4471693f9dbfd60e06834a28 2023-02-16 18:01:52,590 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 18:01:52,590 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 18:01:52,590 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.46 KB heapSize=7.87 KB 2023-02-16 18:01:52,594 DEBUG [RS:0;jenkins-hbase4:41975] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/oldWALs 2023-02-16 18:01:52,594 INFO [RS:0;jenkins-hbase4:41975] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41975%2C1676570509518:(num 1676570510838) 2023-02-16 18:01:52,594 DEBUG [RS:0;jenkins-hbase4:41975] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:52,594 INFO [RS:0;jenkins-hbase4:41975] regionserver.LeaseManager(133): Closed leases 2023-02-16 18:01:52,595 INFO [RS:0;jenkins-hbase4:41975] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-16 18:01:52,595 INFO [RS:0;jenkins-hbase4:41975] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 18:01:52,595 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 18:01:52,595 INFO [RS:0;jenkins-hbase4:41975] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 18:01:52,595 INFO [RS:0;jenkins-hbase4:41975] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 18:01:52,596 INFO [RS:0;jenkins-hbase4:41975] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41975 2023-02-16 18:01:52,597 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): regionserver:41975-0x1005e4baa4d0001, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41975,1676570509518 2023-02-16 18:01:52,597 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:52,597 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): regionserver:38707-0x1005e4baa4d0002, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41975,1676570509518 2023-02-16 18:01:52,598 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): regionserver:38707-0x1005e4baa4d0002, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:52,598 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41975,1676570509518] 2023-02-16 18:01:52,598 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41975,1676570509518; numProcessing=1 2023-02-16 18:01:52,599 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41975,1676570509518 already deleted, retry=false 2023-02-16 18:01:52,599 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41975,1676570509518 expired; onlineServers=1 2023-02-16 18:01:52,599 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): regionserver:41975-0x1005e4baa4d0001, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:52,599 ERROR [Listener at localhost/38001-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5243da69 rejected from java.util.concurrent.ThreadPoolExecutor@567c54f9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:52,604 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/hbase/meta/1588230740/.tmp/info/cb8c53ec3c1b4cbdb1e0e9b9d9671940 2023-02-16 18:01:52,606 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/hbase/namespace/620fc90c4471693f9dbfd60e06834a28/.tmp/info/946b7b047c744bd1b4cb3c87f3135625 2023-02-16 18:01:52,608 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cb8c53ec3c1b4cbdb1e0e9b9d9671940 2023-02-16 18:01:52,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/hbase/namespace/620fc90c4471693f9dbfd60e06834a28/.tmp/info/946b7b047c744bd1b4cb3c87f3135625 as hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/hbase/namespace/620fc90c4471693f9dbfd60e06834a28/info/946b7b047c744bd1b4cb3c87f3135625 2023-02-16 18:01:52,614 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/hbase/namespace/620fc90c4471693f9dbfd60e06834a28/info/946b7b047c744bd1b4cb3c87f3135625, entries=2, sequenceid=6, filesize=4.8 K 2023-02-16 18:01:52,615 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 620fc90c4471693f9dbfd60e06834a28 in 26ms, sequenceid=6, compaction requested=false 2023-02-16 18:01:52,615 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-16 18:01:52,615 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/hbase/meta/1588230740/.tmp/rep_barrier/172237cb618541ad8f8e44e283d1aea6 2023-02-16 18:01:52,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/hbase/namespace/620fc90c4471693f9dbfd60e06834a28/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-16 18:01:52,618 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 172237cb618541ad8f8e44e283d1aea6 2023-02-16 18:01:52,618 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676570510117.620fc90c4471693f9dbfd60e06834a28. 2023-02-16 18:01:52,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 620fc90c4471693f9dbfd60e06834a28: 2023-02-16 18:01:52,619 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676570510117.620fc90c4471693f9dbfd60e06834a28. 2023-02-16 18:01:52,624 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/hbase/meta/1588230740/.tmp/table/2c470050eab247f4aa6dfb03086ec020 2023-02-16 18:01:52,627 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2c470050eab247f4aa6dfb03086ec020 2023-02-16 18:01:52,628 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/hbase/meta/1588230740/.tmp/info/cb8c53ec3c1b4cbdb1e0e9b9d9671940 as hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/hbase/meta/1588230740/info/cb8c53ec3c1b4cbdb1e0e9b9d9671940 2023-02-16 18:01:52,631 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cb8c53ec3c1b4cbdb1e0e9b9d9671940 2023-02-16 18:01:52,631 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/hbase/meta/1588230740/info/cb8c53ec3c1b4cbdb1e0e9b9d9671940, entries=12, sequenceid=21, filesize=6.3 K 2023-02-16 18:01:52,631 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/hbase/meta/1588230740/.tmp/rep_barrier/172237cb618541ad8f8e44e283d1aea6 as hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/hbase/meta/1588230740/rep_barrier/172237cb618541ad8f8e44e283d1aea6 2023-02-16 18:01:52,634 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 172237cb618541ad8f8e44e283d1aea6 2023-02-16 18:01:52,634 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/hbase/meta/1588230740/rep_barrier/172237cb618541ad8f8e44e283d1aea6, entries=1, sequenceid=21, filesize=5.1 K 2023-02-16 18:01:52,635 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/hbase/meta/1588230740/.tmp/table/2c470050eab247f4aa6dfb03086ec020 as hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/hbase/meta/1588230740/table/2c470050eab247f4aa6dfb03086ec020 2023-02-16 18:01:52,638 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2c470050eab247f4aa6dfb03086ec020 2023-02-16 18:01:52,638 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/hbase/meta/1588230740/table/2c470050eab247f4aa6dfb03086ec020, entries=4, sequenceid=21, filesize=5.1 K 2023-02-16 18:01:52,638 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 48ms, sequenceid=21, compaction requested=false 2023-02-16 18:01:52,638 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-16 18:01:52,641 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-16 18:01:52,641 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 18:01:52,642 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 18:01:52,643 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 18:01:52,643 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 18:01:52,643 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 18:01:52,644 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-16 18:01:52,784 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): regionserver:41975-0x1005e4baa4d0001, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:52,784 INFO [RS:0;jenkins-hbase4:41975] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41975,1676570509518; zookeeper connection closed. 2023-02-16 18:01:52,785 ERROR [Listener at localhost/38001-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6efbddc3 rejected from java.util.concurrent.ThreadPoolExecutor@567c54f9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:52,785 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): regionserver:41975-0x1005e4baa4d0001, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:52,785 ERROR [Listener at localhost/38001-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@164891c6 rejected from java.util.concurrent.ThreadPoolExecutor@567c54f9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:52,785 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3a640cc5] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3a640cc5 2023-02-16 18:01:52,790 INFO [RS:1;jenkins-hbase4:38707] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38707,1676570509543; all regions closed. 2023-02-16 18:01:52,796 DEBUG [RS:1;jenkins-hbase4:38707] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/oldWALs 2023-02-16 18:01:52,796 INFO [RS:1;jenkins-hbase4:38707] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38707%2C1676570509543.meta:.meta(num 1676570510058) 2023-02-16 18:01:52,798 DEBUG [RS:1;jenkins-hbase4:38707] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/oldWALs 2023-02-16 18:01:52,799 INFO [RS:1;jenkins-hbase4:38707] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38707%2C1676570509543:(num 1676570510455) 2023-02-16 18:01:52,799 DEBUG [RS:1;jenkins-hbase4:38707] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:52,799 INFO [RS:1;jenkins-hbase4:38707] regionserver.LeaseManager(133): Closed leases 2023-02-16 18:01:52,799 INFO [RS:1;jenkins-hbase4:38707] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-16 18:01:52,799 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 18:01:52,800 INFO [RS:1;jenkins-hbase4:38707] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38707 2023-02-16 18:01:52,801 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): regionserver:38707-0x1005e4baa4d0002, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38707,1676570509543 2023-02-16 18:01:52,801 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:52,801 ERROR [Listener at localhost/38001-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@484ae0fa rejected from java.util.concurrent.ThreadPoolExecutor@4c756d2b[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:52,802 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38707,1676570509543] 2023-02-16 18:01:52,802 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38707,1676570509543; numProcessing=2 2023-02-16 18:01:52,804 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38707,1676570509543 already deleted, retry=false 2023-02-16 18:01:52,804 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38707,1676570509543 expired; onlineServers=0 2023-02-16 18:01:52,804 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43375,1676570509471' ***** 2023-02-16 18:01:52,804 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-16 18:01:52,804 DEBUG [M:0;jenkins-hbase4:43375] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39e7d923, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 18:01:52,805 INFO [M:0;jenkins-hbase4:43375] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43375,1676570509471 2023-02-16 18:01:52,805 INFO [M:0;jenkins-hbase4:43375] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43375,1676570509471; all regions closed. 2023-02-16 18:01:52,805 DEBUG [M:0;jenkins-hbase4:43375] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:52,805 DEBUG [M:0;jenkins-hbase4:43375] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-16 18:01:52,805 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-16 18:01:52,805 DEBUG [M:0;jenkins-hbase4:43375] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-16 18:01:52,805 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676570509700] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676570509700,5,FailOnTimeoutGroup] 2023-02-16 18:01:52,805 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676570509702] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676570509702,5,FailOnTimeoutGroup] 2023-02-16 18:01:52,805 INFO [M:0;jenkins-hbase4:43375] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-16 18:01:52,806 INFO [M:0;jenkins-hbase4:43375] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-16 18:01:52,806 INFO [M:0;jenkins-hbase4:43375] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-16 18:01:52,806 DEBUG [M:0;jenkins-hbase4:43375] master.HMaster(1512): Stopping service threads 2023-02-16 18:01:52,806 INFO [M:0;jenkins-hbase4:43375] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-16 18:01:52,807 ERROR [M:0;jenkins-hbase4:43375] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-16 18:01:52,807 INFO [M:0;jenkins-hbase4:43375] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-16 18:01:52,807 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-16 18:01:52,807 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-16 18:01:52,807 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:52,807 DEBUG [M:0;jenkins-hbase4:43375] zookeeper.ZKUtil(398): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-16 18:01:52,807 WARN [M:0;jenkins-hbase4:43375] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-16 18:01:52,807 INFO [M:0;jenkins-hbase4:43375] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-16 18:01:52,807 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 18:01:52,808 INFO [M:0;jenkins-hbase4:43375] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-16 18:01:52,808 DEBUG [M:0;jenkins-hbase4:43375] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 18:01:52,808 INFO [M:0;jenkins-hbase4:43375] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:52,808 DEBUG [M:0;jenkins-hbase4:43375] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:52,808 DEBUG [M:0;jenkins-hbase4:43375] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 18:01:52,808 DEBUG [M:0;jenkins-hbase4:43375] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:52,808 INFO [M:0;jenkins-hbase4:43375] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.68 KB heapSize=67.66 KB 2023-02-16 18:01:52,816 INFO [M:0;jenkins-hbase4:43375] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.68 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f50654b0c27f4db89baca99679e7133e 2023-02-16 18:01:52,821 DEBUG [M:0;jenkins-hbase4:43375] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f50654b0c27f4db89baca99679e7133e as hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f50654b0c27f4db89baca99679e7133e 2023-02-16 18:01:52,825 INFO [M:0;jenkins-hbase4:43375] regionserver.HStore(1080): Added hdfs://localhost:41483/user/jenkins/test-data/c520139d-2123-acb4-fdd2-2a1697c1ca1a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f50654b0c27f4db89baca99679e7133e, entries=17, sequenceid=132, filesize=8.7 K 2023-02-16 18:01:52,826 INFO [M:0;jenkins-hbase4:43375] regionserver.HRegion(2947): Finished flush of dataSize ~56.68 KB/58040, heapSize ~67.64 KB/69264, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false 2023-02-16 18:01:52,826 INFO [M:0;jenkins-hbase4:43375] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:52,826 DEBUG [M:0;jenkins-hbase4:43375] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 18:01:52,830 INFO [M:0;jenkins-hbase4:43375] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-16 18:01:52,830 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 18:01:52,831 INFO [M:0;jenkins-hbase4:43375] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43375 2023-02-16 18:01:52,832 DEBUG [M:0;jenkins-hbase4:43375] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,43375,1676570509471 already deleted, retry=false 2023-02-16 18:01:53,029 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-16 18:01:53,186 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:53,186 INFO [M:0;jenkins-hbase4:43375] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43375,1676570509471; zookeeper connection closed. 2023-02-16 18:01:53,186 ERROR [Listener at localhost/38001-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5d3b4ec6 rejected from java.util.concurrent.ThreadPoolExecutor@5904c1b9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:53,187 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): master:43375-0x1005e4baa4d0000, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:53,187 ERROR [Listener at localhost/38001-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2a9a0f56 rejected from java.util.concurrent.ThreadPoolExecutor@5904c1b9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:53,286 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): regionserver:38707-0x1005e4baa4d0002, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:53,286 INFO [RS:1;jenkins-hbase4:38707] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38707,1676570509543; zookeeper connection closed. 2023-02-16 18:01:53,286 ERROR [Listener at localhost/38001-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@27668a6a rejected from java.util.concurrent.ThreadPoolExecutor@4c756d2b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:53,286 DEBUG [Listener at localhost/38001-EventThread] zookeeper.ZKWatcher(600): regionserver:38707-0x1005e4baa4d0002, quorum=127.0.0.1:52063, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:53,286 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3d32be2] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3d32be2 2023-02-16 18:01:53,286 ERROR [Listener at localhost/38001-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5fcfdd54 rejected from java.util.concurrent.ThreadPoolExecutor@4c756d2b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:53,286 INFO [Listener at localhost/38001] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-16 18:01:53,287 WARN [Listener at localhost/38001] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 18:01:53,291 INFO [Listener at localhost/38001] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 18:01:53,395 WARN [BP-1973025123-172.31.14.131-1676570508869 heartbeating to localhost/127.0.0.1:41483] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 18:01:53,395 WARN [BP-1973025123-172.31.14.131-1676570508869 heartbeating to localhost/127.0.0.1:41483] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1973025123-172.31.14.131-1676570508869 (Datanode Uuid 3f37fcee-c022-41c2-b7c5-26cf409e6de3) service to localhost/127.0.0.1:41483 2023-02-16 18:01:53,395 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1312edfc-6697-ba4e-cb98-30a3eded32e2/cluster_2a5e7b90-fe00-c162-ecb0-a51feafcdfef/dfs/data/data3/current/BP-1973025123-172.31.14.131-1676570508869] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 18:01:53,396 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1312edfc-6697-ba4e-cb98-30a3eded32e2/cluster_2a5e7b90-fe00-c162-ecb0-a51feafcdfef/dfs/data/data4/current/BP-1973025123-172.31.14.131-1676570508869] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 18:01:53,397 WARN [Listener at localhost/38001] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 18:01:53,400 INFO [Listener at localhost/38001] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 18:01:53,503 WARN [BP-1973025123-172.31.14.131-1676570508869 heartbeating to localhost/127.0.0.1:41483] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 18:01:53,503 WARN [BP-1973025123-172.31.14.131-1676570508869 heartbeating to localhost/127.0.0.1:41483] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1973025123-172.31.14.131-1676570508869 (Datanode Uuid 3f72dc86-c384-4af2-a06b-720a0e979fe9) service to localhost/127.0.0.1:41483 2023-02-16 18:01:53,504 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1312edfc-6697-ba4e-cb98-30a3eded32e2/cluster_2a5e7b90-fe00-c162-ecb0-a51feafcdfef/dfs/data/data1/current/BP-1973025123-172.31.14.131-1676570508869] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 18:01:53,504 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1312edfc-6697-ba4e-cb98-30a3eded32e2/cluster_2a5e7b90-fe00-c162-ecb0-a51feafcdfef/dfs/data/data2/current/BP-1973025123-172.31.14.131-1676570508869] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 18:01:53,514 INFO [Listener at localhost/38001] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 18:01:53,628 INFO [Listener at localhost/38001] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-16 18:01:53,649 INFO [Listener at localhost/38001] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-16 18:01:53,666 INFO [Listener at localhost/38001] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=270 (was 252) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:41483 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1124632911) connection to localhost/127.0.0.1:41483 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,43375,1676570509471)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1124632911) connection to localhost/127.0.0.1:41483 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost:41483 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/38001 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1124632911) connection to localhost/127.0.0.1:41483 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1124632911) connection to localhost/127.0.0.1:41483 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost:41483 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=564 (was 654), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=261 (was 266), ProcessCount=170 (was 170), AvailableMemoryMB=1005 (was 1084) 2023-02-16 18:01:53,679 INFO [Listener at localhost/38001] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=270, OpenFileDescriptor=564, MaxFileDescriptor=60000, SystemLoadAverage=261, ProcessCount=170, AvailableMemoryMB=1005 2023-02-16 18:01:53,692 INFO [Listener at localhost/38001] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1312edfc-6697-ba4e-cb98-30a3eded32e2/hadoop.log.dir so I do NOT create it in target/test-data/944328f3-acc6-4077-0b2f-eb3e984b25b3 2023-02-16 18:01:53,692 WARN [Listener at localhost/38001] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1312edfc-6697-ba4e-cb98-30a3eded32e2/hadoop.log.dir Erasing configuration value by system value. 2023-02-16 18:01:53,692 INFO [Listener at localhost/38001] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1312edfc-6697-ba4e-cb98-30a3eded32e2/hadoop.tmp.dir so I do NOT create it in target/test-data/944328f3-acc6-4077-0b2f-eb3e984b25b3 2023-02-16 18:01:53,692 WARN [Listener at localhost/38001] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1312edfc-6697-ba4e-cb98-30a3eded32e2/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-16 18:01:53,692 DEBUG [Listener at localhost/38001] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/944328f3-acc6-4077-0b2f-eb3e984b25b3 2023-02-16 18:01:53,692 INFO [Listener at localhost/38001] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-16 18:01:53,693 INFO [Listener at localhost/38001] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/944328f3-acc6-4077-0b2f-eb3e984b25b3/cluster_2f19ce4a-4bf5-c028-f8c0-e734d9205edb, deleteOnExit=true 2023-02-16 18:01:53,693 INFO [Listener at localhost/38001] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-16 18:01:53,693 INFO [Listener at localhost/38001] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/944328f3-acc6-4077-0b2f-eb3e984b25b3/test.cache.data in system properties and HBase conf 2023-02-16 18:01:53,693 INFO [Listener at localhost/38001] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/944328f3-acc6-4077-0b2f-eb3e984b25b3/hadoop.tmp.dir in system properties and HBase conf 2023-02-16 18:01:53,693 INFO [Listener at localhost/38001] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/944328f3-acc6-4077-0b2f-eb3e984b25b3/hadoop.log.dir in system properties and HBase conf 2023-02-16 18:01:53,693 INFO [Listener at localhost/38001] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/944328f3-acc6-4077-0b2f-eb3e984b25b3/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-16 18:01:53,694 INFO [Listener at localhost/38001] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/944328f3-acc6-4077-0b2f-eb3e984b25b3/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-16 18:01:53,694 INFO [Listener at localhost/38001] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-16 18:01:53,694 DEBUG [Listener at localhost/38001] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-16 18:01:53,694 INFO [Listener at localhost/38001] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/944328f3-acc6-4077-0b2f-eb3e984b25b3/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-16 18:01:53,694 INFO [Listener at localhost/38001] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/944328f3-acc6-4077-0b2f-eb3e984b25b3/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-16 18:01:53,694 INFO [Listener at localhost/38001] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/944328f3-acc6-4077-0b2f-eb3e984b25b3/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-16 18:01:53,694 INFO [Listener at localhost/38001] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/944328f3-acc6-4077-0b2f-eb3e984b25b3/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 18:01:53,694 INFO [Listener at localhost/38001] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/944328f3-acc6-4077-0b2f-eb3e984b25b3/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-16 18:01:53,695 INFO [Listener at localhost/38001] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/944328f3-acc6-4077-0b2f-eb3e984b25b3/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-16 18:01:53,695 INFO [Listener at localhost/38001] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/944328f3-acc6-4077-0b2f-eb3e984b25b3/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 18:01:53,695 INFO [Listener at localhost/38001] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/944328f3-acc6-4077-0b2f-eb3e984b25b3/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 18:01:53,695 INFO [Listener at localhost/38001] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/944328f3-acc6-4077-0b2f-eb3e984b25b3/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-16 18:01:53,695 INFO [Listener at localhost/38001] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/944328f3-acc6-4077-0b2f-eb3e984b25b3/nfs.dump.dir in system properties and HBase conf 2023-02-16 18:01:53,695 INFO [Listener at localhost/38001] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/944328f3-acc6-4077-0b2f-eb3e984b25b3/java.io.tmpdir in system properties and HBase conf 2023-02-16 18:01:53,695 INFO [Listener at localhost/38001] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/944328f3-acc6-4077-0b2f-eb3e984b25b3/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 18:01:53,695 INFO [Listener at localhost/38001] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/944328f3-acc6-4077-0b2f-eb3e984b25b3/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-16 18:01:53,695 INFO [Listener at localhost/38001] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/944328f3-acc6-4077-0b2f-eb3e984b25b3/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-16 18:01:53,699 WARN [Listener at localhost/38001] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 18:01:53,699 WARN [Listener at localhost/38001] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 18:01:53,738 WARN [Listener at localhost/38001] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 18:01:53,740 INFO [Listener at localhost/38001] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 18:01:53,744 INFO [Listener at localhost/38001] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/944328f3-acc6-4077-0b2f-eb3e984b25b3/java.io.tmpdir/Jetty_localhost_46463_hdfs____.smgs9z/webapp 2023-02-16 18:01:53,835 INFO [Listener at localhost/38001] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46463 2023-02-16 18:01:53,839 WARN [Listener at localhost/38001] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 18:01:53,839 WARN [Listener at localhost/38001] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 18:01:53,883 WARN [Listener at localhost/43359] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 18:01:53,893 WARN [Listener at localhost/43359] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 18:01:53,896 WARN [Listener at localhost/43359] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 18:01:53,897 INFO [Listener at localhost/43359] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 18:01:53,901 INFO [Listener at localhost/43359] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/944328f3-acc6-4077-0b2f-eb3e984b25b3/java.io.tmpdir/Jetty_localhost_46443_datanode____e7go60/webapp 2023-02-16 18:01:53,993 INFO [Listener at localhost/43359] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46443 2023-02-16 18:01:54,009 WARN [Listener at localhost/37225] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 18:01:54,025 WARN [Listener at localhost/37225] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 18:01:54,027 WARN [Listener at localhost/37225] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 18:01:54,028 INFO [Listener at localhost/37225] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 18:01:54,031 INFO [Listener at localhost/37225] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/944328f3-acc6-4077-0b2f-eb3e984b25b3/java.io.tmpdir/Jetty_localhost_34541_datanode____.roj414/webapp 2023-02-16 18:01:54,119 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb640fc4c41b14ca5: Processing first storage report for DS-356a2f68-07d4-4551-820c-6e810b402be3 from datanode 1b63840c-8284-48cf-8d99-810330b36b57 2023-02-16 18:01:54,119 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb640fc4c41b14ca5: from storage DS-356a2f68-07d4-4551-820c-6e810b402be3 node DatanodeRegistration(127.0.0.1:44923, datanodeUuid=1b63840c-8284-48cf-8d99-810330b36b57, infoPort=42293, infoSecurePort=0, ipcPort=37225, storageInfo=lv=-57;cid=testClusterID;nsid=603424928;c=1676570513702), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 18:01:54,119 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb640fc4c41b14ca5: Processing first storage report for DS-ba4ae572-2696-43f3-837b-d7fa83466f5a from datanode 1b63840c-8284-48cf-8d99-810330b36b57 2023-02-16 18:01:54,119 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb640fc4c41b14ca5: from storage DS-ba4ae572-2696-43f3-837b-d7fa83466f5a node DatanodeRegistration(127.0.0.1:44923, datanodeUuid=1b63840c-8284-48cf-8d99-810330b36b57, infoPort=42293, infoSecurePort=0, ipcPort=37225, storageInfo=lv=-57;cid=testClusterID;nsid=603424928;c=1676570513702), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 18:01:54,145 INFO [Listener at localhost/37225] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34541 2023-02-16 18:01:54,158 WARN [Listener at localhost/33589] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 18:01:54,255 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x546380c428aae68b: Processing first storage report for DS-34176839-717a-401f-908e-da8453bdbd9d from datanode 3e96bb74-0033-4b7f-b394-95ab73fc3cf3 2023-02-16 18:01:54,255 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x546380c428aae68b: from storage DS-34176839-717a-401f-908e-da8453bdbd9d node DatanodeRegistration(127.0.0.1:38761, datanodeUuid=3e96bb74-0033-4b7f-b394-95ab73fc3cf3, infoPort=40113, infoSecurePort=0, ipcPort=33589, storageInfo=lv=-57;cid=testClusterID;nsid=603424928;c=1676570513702), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 18:01:54,255 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x546380c428aae68b: Processing first storage report for DS-9dc98fe5-0e12-4b5d-a658-b9c69abe8366 from datanode 3e96bb74-0033-4b7f-b394-95ab73fc3cf3 2023-02-16 18:01:54,255 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x546380c428aae68b: from storage DS-9dc98fe5-0e12-4b5d-a658-b9c69abe8366 node DatanodeRegistration(127.0.0.1:38761, datanodeUuid=3e96bb74-0033-4b7f-b394-95ab73fc3cf3, infoPort=40113, infoSecurePort=0, ipcPort=33589, storageInfo=lv=-57;cid=testClusterID;nsid=603424928;c=1676570513702), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 18:01:54,265 DEBUG [Listener at localhost/33589] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/944328f3-acc6-4077-0b2f-eb3e984b25b3 2023-02-16 18:01:54,272 INFO [Listener at localhost/33589] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/944328f3-acc6-4077-0b2f-eb3e984b25b3/cluster_2f19ce4a-4bf5-c028-f8c0-e734d9205edb/zookeeper_0, clientPort=59223, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/944328f3-acc6-4077-0b2f-eb3e984b25b3/cluster_2f19ce4a-4bf5-c028-f8c0-e734d9205edb/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/944328f3-acc6-4077-0b2f-eb3e984b25b3/cluster_2f19ce4a-4bf5-c028-f8c0-e734d9205edb/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-16 18:01:54,273 INFO [Listener at localhost/33589] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=59223 2023-02-16 18:01:54,274 INFO [Listener at localhost/33589] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:54,275 INFO [Listener at localhost/33589] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:54,298 INFO [Listener at localhost/33589] util.FSUtils(479): Created version file at hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891 with version=8 2023-02-16 18:01:54,298 INFO [Listener at localhost/33589] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:54,299 INFO [Listener at localhost/33589] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:54,301 INFO [Listener at localhost/33589] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:43359/user/jenkins/test-data/da346747-dbe0-3b30-6e66-9d138f9d88f8/hbase-staging 2023-02-16 18:01:54,302 INFO [Listener at localhost/33589] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 18:01:54,303 INFO [Listener at localhost/33589] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:54,303 INFO [Listener at localhost/33589] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:54,303 INFO [Listener at localhost/33589] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 18:01:54,303 INFO [Listener at localhost/33589] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:54,303 INFO [Listener at localhost/33589] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 18:01:54,303 INFO [Listener at localhost/33589] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 18:01:54,304 INFO [Listener at localhost/33589] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41753 2023-02-16 18:01:54,304 INFO [Listener at localhost/33589] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:54,305 INFO [Listener at localhost/33589] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:54,306 INFO [Listener at localhost/33589] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41753 connecting to ZooKeeper ensemble=127.0.0.1:59223 2023-02-16 18:01:54,317 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:417530x0, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 18:01:54,319 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:41753-0x1005e4bbd1f0000 connected 2023-02-16 18:01:54,333 DEBUG [Listener at localhost/33589] zookeeper.ZKUtil(164): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 18:01:54,333 DEBUG [Listener at localhost/33589] zookeeper.ZKUtil(164): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:54,333 DEBUG [Listener at localhost/33589] zookeeper.ZKUtil(164): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 18:01:54,334 DEBUG [Listener at localhost/33589] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41753 2023-02-16 18:01:54,334 DEBUG [Listener at localhost/33589] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41753 2023-02-16 18:01:54,334 DEBUG [Listener at localhost/33589] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41753 2023-02-16 18:01:54,334 DEBUG [Listener at localhost/33589] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41753 2023-02-16 18:01:54,335 DEBUG [Listener at localhost/33589] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41753 2023-02-16 18:01:54,335 INFO [Listener at localhost/33589] master.HMaster(444): hbase.rootdir=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891, hbase.cluster.distributed=false 2023-02-16 18:01:54,347 INFO [Listener at localhost/33589] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 18:01:54,347 INFO [Listener at localhost/33589] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:54,347 INFO [Listener at localhost/33589] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:54,347 INFO [Listener at localhost/33589] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 18:01:54,347 INFO [Listener at localhost/33589] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:54,347 INFO [Listener at localhost/33589] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 18:01:54,347 INFO [Listener at localhost/33589] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 18:01:54,348 INFO [Listener at localhost/33589] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44231 2023-02-16 18:01:54,348 INFO [Listener at localhost/33589] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 18:01:54,351 DEBUG [Listener at localhost/33589] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:54,352 INFO [Listener at localhost/33589] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:54,352 INFO [Listener at localhost/33589] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:54,353 INFO [Listener at localhost/33589] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44231 connecting to ZooKeeper ensemble=127.0.0.1:59223 2023-02-16 18:01:54,355 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): regionserver:442310x0, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 18:01:54,358 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44231-0x1005e4bbd1f0001 connected 2023-02-16 18:01:54,358 DEBUG [Listener at localhost/33589] zookeeper.ZKUtil(164): regionserver:44231-0x1005e4bbd1f0001, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 18:01:54,359 DEBUG [Listener at localhost/33589] zookeeper.ZKUtil(164): regionserver:44231-0x1005e4bbd1f0001, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:54,359 DEBUG [Listener at localhost/33589] zookeeper.ZKUtil(164): regionserver:44231-0x1005e4bbd1f0001, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 18:01:54,360 DEBUG [Listener at localhost/33589] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44231 2023-02-16 18:01:54,360 DEBUG [Listener at localhost/33589] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44231 2023-02-16 18:01:54,360 DEBUG [Listener at localhost/33589] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44231 2023-02-16 18:01:54,360 DEBUG [Listener at localhost/33589] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44231 2023-02-16 18:01:54,361 DEBUG [Listener at localhost/33589] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44231 2023-02-16 18:01:54,371 INFO [Listener at localhost/33589] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 18:01:54,371 INFO [Listener at localhost/33589] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:54,371 INFO [Listener at localhost/33589] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:54,371 INFO [Listener at localhost/33589] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 18:01:54,371 INFO [Listener at localhost/33589] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 18:01:54,371 INFO [Listener at localhost/33589] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 18:01:54,371 INFO [Listener at localhost/33589] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 18:01:54,372 INFO [Listener at localhost/33589] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42067 2023-02-16 18:01:54,372 INFO [Listener at localhost/33589] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 18:01:54,373 DEBUG [Listener at localhost/33589] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:54,373 INFO [Listener at localhost/33589] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:54,374 INFO [Listener at localhost/33589] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:54,374 INFO [Listener at localhost/33589] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42067 connecting to ZooKeeper ensemble=127.0.0.1:59223 2023-02-16 18:01:54,377 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): regionserver:420670x0, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 18:01:54,378 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42067-0x1005e4bbd1f0002 connected 2023-02-16 18:01:54,378 DEBUG [Listener at localhost/33589] zookeeper.ZKUtil(164): regionserver:42067-0x1005e4bbd1f0002, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 18:01:54,379 DEBUG [Listener at localhost/33589] zookeeper.ZKUtil(164): regionserver:42067-0x1005e4bbd1f0002, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:54,379 DEBUG [Listener at localhost/33589] zookeeper.ZKUtil(164): regionserver:42067-0x1005e4bbd1f0002, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 18:01:54,379 DEBUG [Listener at localhost/33589] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42067 2023-02-16 18:01:54,380 DEBUG [Listener at localhost/33589] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42067 2023-02-16 18:01:54,380 DEBUG [Listener at localhost/33589] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42067 2023-02-16 18:01:54,380 DEBUG [Listener at localhost/33589] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42067 2023-02-16 18:01:54,380 DEBUG [Listener at localhost/33589] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42067 2023-02-16 18:01:54,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,41753,1676570514302 2023-02-16 18:01:54,383 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 18:01:54,383 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,41753,1676570514302 2023-02-16 18:01:54,384 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): regionserver:44231-0x1005e4bbd1f0001, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 18:01:54,384 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): regionserver:42067-0x1005e4bbd1f0002, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 18:01:54,384 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 18:01:54,386 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:54,387 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 18:01:54,388 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,41753,1676570514302 from backup master directory 2023-02-16 18:01:54,388 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 18:01:54,389 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,41753,1676570514302 2023-02-16 18:01:54,389 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 18:01:54,389 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 18:01:54,389 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,41753,1676570514302 2023-02-16 18:01:54,397 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/hbase.id with ID: c9e25972-5c11-49bb-bbdd-88c1b984debd 2023-02-16 18:01:54,405 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 18:01:54,408 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:54,413 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x664ecd67 to 127.0.0.1:59223 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 18:01:54,416 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a943c9d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 18:01:54,416 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 18:01:54,416 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-16 18:01:54,416 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 18:01:54,418 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/MasterData/data/master/store-tmp 2023-02-16 18:01:54,423 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:54,423 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 18:01:54,423 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:54,423 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:54,423 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 18:01:54,423 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:54,423 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:54,423 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 18:01:54,423 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/MasterData/WALs/jenkins-hbase4.apache.org,41753,1676570514302 2023-02-16 18:01:54,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41753%2C1676570514302, suffix=, logDir=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/MasterData/WALs/jenkins-hbase4.apache.org,41753,1676570514302, archiveDir=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/MasterData/oldWALs, maxLogs=10 2023-02-16 18:01:54,437 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38761,DS-34176839-717a-401f-908e-da8453bdbd9d,DISK] 2023-02-16 18:01:54,437 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44923,DS-356a2f68-07d4-4551-820c-6e810b402be3,DISK] 2023-02-16 18:01:54,439 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/MasterData/WALs/jenkins-hbase4.apache.org,41753,1676570514302/jenkins-hbase4.apache.org%2C41753%2C1676570514302.1676570514425 2023-02-16 18:01:54,439 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38761,DS-34176839-717a-401f-908e-da8453bdbd9d,DISK], DatanodeInfoWithStorage[127.0.0.1:44923,DS-356a2f68-07d4-4551-820c-6e810b402be3,DISK]] 2023-02-16 18:01:54,439 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-16 18:01:54,439 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:54,439 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:54,439 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:54,440 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:54,441 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-16 18:01:54,441 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-16 18:01:54,442 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:54,442 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:54,443 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:54,444 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 18:01:54,445 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:54,446 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66933321, jitterRate=-0.002615794539451599}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 18:01:54,446 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 18:01:54,446 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-16 18:01:54,447 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-16 18:01:54,447 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-16 18:01:54,447 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-16 18:01:54,448 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-16 18:01:54,448 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-16 18:01:54,448 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-16 18:01:54,454 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-16 18:01:54,454 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-16 18:01:54,464 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-16 18:01:54,464 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-16 18:01:54,465 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-16 18:01:54,465 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-16 18:01:54,465 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-16 18:01:54,467 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:54,467 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-16 18:01:54,467 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-16 18:01:54,468 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-16 18:01:54,469 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:54,469 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): regionserver:42067-0x1005e4bbd1f0002, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:54,469 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): regionserver:44231-0x1005e4bbd1f0001, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:54,469 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:54,469 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,41753,1676570514302, sessionid=0x1005e4bbd1f0000, setting cluster-up flag (Was=false) 2023-02-16 18:01:54,479 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:54,483 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-16 18:01:54,484 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41753,1676570514302 2023-02-16 18:01:54,486 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:54,490 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-16 18:01:54,490 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41753,1676570514302 2023-02-16 18:01:54,491 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/.hbase-snapshot/.tmp 2023-02-16 18:01:54,492 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-16 18:01:54,492 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 18:01:54,492 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 18:01:54,492 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 18:01:54,492 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 18:01:54,492 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-16 18:01:54,492 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:54,492 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 18:01:54,492 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:54,496 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676570544496 2023-02-16 18:01:54,496 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-16 18:01:54,497 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-16 18:01:54,497 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-16 18:01:54,497 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-16 18:01:54,497 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-16 18:01:54,497 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 18:01:54,497 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-16 18:01:54,497 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-16 18:01:54,497 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:54,498 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-16 18:01:54,498 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-16 18:01:54,498 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-16 18:01:54,498 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-16 18:01:54,498 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-16 18:01:54,498 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676570514498,5,FailOnTimeoutGroup] 2023-02-16 18:01:54,498 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 18:01:54,498 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676570514498,5,FailOnTimeoutGroup] 2023-02-16 18:01:54,498 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:54,498 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-16 18:01:54,498 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:54,498 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:54,505 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 18:01:54,505 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 18:01:54,505 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891 2023-02-16 18:01:54,510 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:54,511 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 18:01:54,511 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/hbase/meta/1588230740/info 2023-02-16 18:01:54,512 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 18:01:54,512 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:54,512 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 18:01:54,513 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/hbase/meta/1588230740/rep_barrier 2023-02-16 18:01:54,513 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 18:01:54,513 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:54,514 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 18:01:54,514 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/hbase/meta/1588230740/table 2023-02-16 18:01:54,515 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 18:01:54,515 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:54,515 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/hbase/meta/1588230740 2023-02-16 18:01:54,516 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/hbase/meta/1588230740 2023-02-16 18:01:54,517 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 18:01:54,518 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 18:01:54,520 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:54,521 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65163893, jitterRate=-0.02898232638835907}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 18:01:54,521 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 18:01:54,521 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 18:01:54,521 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 18:01:54,521 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 18:01:54,521 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 18:01:54,521 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 18:01:54,521 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 18:01:54,521 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 18:01:54,522 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 18:01:54,522 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-16 18:01:54,522 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-16 18:01:54,524 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-16 18:01:54,525 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-16 18:01:54,583 INFO [RS:0;jenkins-hbase4:44231] regionserver.HRegionServer(952): ClusterId : c9e25972-5c11-49bb-bbdd-88c1b984debd 2023-02-16 18:01:54,583 DEBUG [RS:0;jenkins-hbase4:44231] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 18:01:54,585 DEBUG [RS:0;jenkins-hbase4:44231] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 18:01:54,585 DEBUG [RS:0;jenkins-hbase4:44231] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 18:01:54,585 INFO [RS:1;jenkins-hbase4:42067] regionserver.HRegionServer(952): ClusterId : c9e25972-5c11-49bb-bbdd-88c1b984debd 2023-02-16 18:01:54,585 DEBUG [RS:1;jenkins-hbase4:42067] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 18:01:54,588 DEBUG [RS:0;jenkins-hbase4:44231] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 18:01:54,589 DEBUG [RS:0;jenkins-hbase4:44231] zookeeper.ReadOnlyZKClient(139): Connect 0x5a18d62e to 127.0.0.1:59223 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 18:01:54,594 DEBUG [RS:1;jenkins-hbase4:42067] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 18:01:54,594 DEBUG [RS:1;jenkins-hbase4:42067] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 18:01:54,596 DEBUG [RS:1;jenkins-hbase4:42067] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 18:01:54,596 DEBUG [RS:0;jenkins-hbase4:44231] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@54df331d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 18:01:54,597 DEBUG [RS:1;jenkins-hbase4:42067] zookeeper.ReadOnlyZKClient(139): Connect 0x7a1c9f45 to 127.0.0.1:59223 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 18:01:54,597 DEBUG [RS:0;jenkins-hbase4:44231] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@50e0bd5e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 18:01:54,599 DEBUG [RS:1;jenkins-hbase4:42067] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74db7e76, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 18:01:54,599 DEBUG [RS:1;jenkins-hbase4:42067] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70e4f435, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 18:01:54,606 DEBUG [RS:0;jenkins-hbase4:44231] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:44231 2023-02-16 18:01:54,606 INFO [RS:0;jenkins-hbase4:44231] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 18:01:54,607 INFO [RS:0;jenkins-hbase4:44231] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 18:01:54,607 DEBUG [RS:0;jenkins-hbase4:44231] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 18:01:54,607 INFO [RS:0;jenkins-hbase4:44231] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41753,1676570514302 with isa=jenkins-hbase4.apache.org/172.31.14.131:44231, startcode=1676570514346 2023-02-16 18:01:54,607 DEBUG [RS:0;jenkins-hbase4:44231] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 18:01:54,611 DEBUG [RS:1;jenkins-hbase4:42067] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:42067 2023-02-16 18:01:54,611 INFO [RS:1;jenkins-hbase4:42067] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 18:01:54,611 INFO [RS:1;jenkins-hbase4:42067] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 18:01:54,611 DEBUG [RS:1;jenkins-hbase4:42067] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 18:01:54,612 INFO [RS:1;jenkins-hbase4:42067] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41753,1676570514302 with isa=jenkins-hbase4.apache.org/172.31.14.131:42067, startcode=1676570514371 2023-02-16 18:01:54,612 DEBUG [RS:1;jenkins-hbase4:42067] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 18:01:54,613 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34055, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 18:01:54,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:54,615 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32789, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 18:01:54,616 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42067,1676570514371 2023-02-16 18:01:54,616 DEBUG [RS:0;jenkins-hbase4:44231] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891 2023-02-16 18:01:54,616 DEBUG [RS:0;jenkins-hbase4:44231] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:43359 2023-02-16 18:01:54,616 DEBUG [RS:0;jenkins-hbase4:44231] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 18:01:54,616 DEBUG [RS:1;jenkins-hbase4:42067] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891 2023-02-16 18:01:54,616 DEBUG [RS:1;jenkins-hbase4:42067] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:43359 2023-02-16 18:01:54,616 DEBUG [RS:1;jenkins-hbase4:42067] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 18:01:54,618 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:54,622 DEBUG [RS:0;jenkins-hbase4:44231] zookeeper.ZKUtil(162): regionserver:44231-0x1005e4bbd1f0001, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:54,622 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44231,1676570514346] 2023-02-16 18:01:54,622 WARN [RS:0;jenkins-hbase4:44231] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 18:01:54,622 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42067,1676570514371] 2023-02-16 18:01:54,622 INFO [RS:0;jenkins-hbase4:44231] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 18:01:54,622 DEBUG [RS:0;jenkins-hbase4:44231] regionserver.HRegionServer(1947): logDir=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/WALs/jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:54,628 DEBUG [RS:1;jenkins-hbase4:42067] zookeeper.ZKUtil(162): regionserver:42067-0x1005e4bbd1f0002, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42067,1676570514371 2023-02-16 18:01:54,629 WARN [RS:1;jenkins-hbase4:42067] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 18:01:54,629 INFO [RS:1;jenkins-hbase4:42067] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 18:01:54,629 DEBUG [RS:1;jenkins-hbase4:42067] regionserver.HRegionServer(1947): logDir=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/WALs/jenkins-hbase4.apache.org,42067,1676570514371 2023-02-16 18:01:54,630 DEBUG [RS:0;jenkins-hbase4:44231] zookeeper.ZKUtil(162): regionserver:44231-0x1005e4bbd1f0001, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:54,630 DEBUG [RS:0;jenkins-hbase4:44231] zookeeper.ZKUtil(162): regionserver:44231-0x1005e4bbd1f0001, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42067,1676570514371 2023-02-16 18:01:54,631 DEBUG [RS:0;jenkins-hbase4:44231] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 18:01:54,632 INFO [RS:0;jenkins-hbase4:44231] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 18:01:54,653 INFO [RS:0;jenkins-hbase4:44231] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 18:01:54,653 INFO [RS:0;jenkins-hbase4:44231] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 18:01:54,654 INFO [RS:0;jenkins-hbase4:44231] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:54,654 DEBUG [RS:1;jenkins-hbase4:42067] zookeeper.ZKUtil(162): regionserver:42067-0x1005e4bbd1f0002, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:54,655 DEBUG [RS:1;jenkins-hbase4:42067] zookeeper.ZKUtil(162): regionserver:42067-0x1005e4bbd1f0002, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42067,1676570514371 2023-02-16 18:01:54,656 DEBUG [RS:1;jenkins-hbase4:42067] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 18:01:54,656 INFO [RS:1;jenkins-hbase4:42067] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 18:01:54,675 DEBUG [jenkins-hbase4:41753] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-16 18:01:54,675 DEBUG [jenkins-hbase4:41753] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 18:01:54,676 INFO [RS:0;jenkins-hbase4:44231] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 18:01:54,677 INFO [RS:1;jenkins-hbase4:42067] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 18:01:54,677 DEBUG [jenkins-hbase4:41753] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 18:01:54,677 DEBUG [jenkins-hbase4:41753] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 18:01:54,677 DEBUG [jenkins-hbase4:41753] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 18:01:54,684 INFO [RS:1;jenkins-hbase4:42067] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 18:01:54,684 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42067,1676570514371, state=OPENING 2023-02-16 18:01:54,684 INFO [RS:1;jenkins-hbase4:42067] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:54,685 INFO [RS:1;jenkins-hbase4:42067] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 18:01:54,686 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-16 18:01:54,686 INFO [RS:1;jenkins-hbase4:42067] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:54,687 INFO [RS:0;jenkins-hbase4:44231] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:54,688 DEBUG [RS:1;jenkins-hbase4:42067] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:54,688 DEBUG [RS:0;jenkins-hbase4:44231] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:54,691 DEBUG [RS:0;jenkins-hbase4:44231] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:54,691 DEBUG [RS:0;jenkins-hbase4:44231] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:54,691 DEBUG [RS:0;jenkins-hbase4:44231] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:54,691 DEBUG [RS:0;jenkins-hbase4:44231] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:54,691 DEBUG [RS:0;jenkins-hbase4:44231] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 18:01:54,691 DEBUG [RS:0;jenkins-hbase4:44231] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:54,691 DEBUG [RS:0;jenkins-hbase4:44231] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:54,691 DEBUG [RS:0;jenkins-hbase4:44231] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:54,691 DEBUG [RS:0;jenkins-hbase4:44231] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:54,692 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:54,691 DEBUG [RS:1;jenkins-hbase4:42067] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:54,692 DEBUG [RS:1;jenkins-hbase4:42067] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:54,693 DEBUG [RS:1;jenkins-hbase4:42067] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:54,693 DEBUG [RS:1;jenkins-hbase4:42067] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:54,693 DEBUG [RS:1;jenkins-hbase4:42067] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 18:01:54,693 DEBUG [RS:1;jenkins-hbase4:42067] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:54,693 DEBUG [RS:1;jenkins-hbase4:42067] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:54,693 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42067,1676570514371}] 2023-02-16 18:01:54,693 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 18:01:54,693 DEBUG [RS:1;jenkins-hbase4:42067] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:54,693 DEBUG [RS:1;jenkins-hbase4:42067] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 18:01:54,716 INFO [RS:1;jenkins-hbase4:42067] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:54,718 INFO [RS:1;jenkins-hbase4:42067] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:54,719 INFO [RS:1;jenkins-hbase4:42067] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:54,720 INFO [RS:0;jenkins-hbase4:44231] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:54,720 INFO [RS:0;jenkins-hbase4:44231] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:54,720 INFO [RS:0;jenkins-hbase4:44231] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:54,739 INFO [RS:1;jenkins-hbase4:42067] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 18:01:54,739 INFO [RS:1;jenkins-hbase4:42067] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42067,1676570514371-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:54,741 INFO [RS:0;jenkins-hbase4:44231] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 18:01:54,742 INFO [RS:0;jenkins-hbase4:44231] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44231,1676570514346-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:54,768 INFO [RS:0;jenkins-hbase4:44231] regionserver.Replication(203): jenkins-hbase4.apache.org,44231,1676570514346 started 2023-02-16 18:01:54,768 INFO [RS:0;jenkins-hbase4:44231] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,44231,1676570514346, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44231, sessionid=0x1005e4bbd1f0001 2023-02-16 18:01:54,779 INFO [RS:1;jenkins-hbase4:42067] regionserver.Replication(203): jenkins-hbase4.apache.org,42067,1676570514371 started 2023-02-16 18:01:54,780 INFO [RS:1;jenkins-hbase4:42067] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,42067,1676570514371, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42067, sessionid=0x1005e4bbd1f0002 2023-02-16 18:01:54,780 DEBUG [RS:1;jenkins-hbase4:42067] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 18:01:54,780 DEBUG [RS:1;jenkins-hbase4:42067] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42067,1676570514371 2023-02-16 18:01:54,780 DEBUG [RS:1;jenkins-hbase4:42067] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42067,1676570514371' 2023-02-16 18:01:54,780 DEBUG [RS:1;jenkins-hbase4:42067] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:54,780 DEBUG [RS:0;jenkins-hbase4:44231] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 18:01:54,780 DEBUG [RS:0;jenkins-hbase4:44231] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:54,780 DEBUG [RS:0;jenkins-hbase4:44231] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44231,1676570514346' 2023-02-16 18:01:54,780 DEBUG [RS:0;jenkins-hbase4:44231] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:54,780 DEBUG [RS:1;jenkins-hbase4:42067] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:54,781 DEBUG [RS:0;jenkins-hbase4:44231] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:54,781 DEBUG [RS:1;jenkins-hbase4:42067] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 18:01:54,781 DEBUG [RS:1;jenkins-hbase4:42067] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 18:01:54,781 DEBUG [RS:1;jenkins-hbase4:42067] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42067,1676570514371 2023-02-16 18:01:54,781 DEBUG [RS:1;jenkins-hbase4:42067] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42067,1676570514371' 2023-02-16 18:01:54,781 DEBUG [RS:1;jenkins-hbase4:42067] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:54,782 DEBUG [RS:1;jenkins-hbase4:42067] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:54,782 DEBUG [RS:0;jenkins-hbase4:44231] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 18:01:54,782 DEBUG [RS:0;jenkins-hbase4:44231] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 18:01:54,782 DEBUG [RS:0;jenkins-hbase4:44231] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:54,782 DEBUG [RS:0;jenkins-hbase4:44231] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44231,1676570514346' 2023-02-16 18:01:54,782 DEBUG [RS:0;jenkins-hbase4:44231] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:54,782 DEBUG [RS:1;jenkins-hbase4:42067] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 18:01:54,782 INFO [RS:1;jenkins-hbase4:42067] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 18:01:54,782 DEBUG [RS:0;jenkins-hbase4:44231] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:54,782 INFO [RS:1;jenkins-hbase4:42067] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 18:01:54,783 DEBUG [RS:0;jenkins-hbase4:44231] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 18:01:54,783 INFO [RS:0;jenkins-hbase4:44231] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 18:01:54,783 INFO [RS:0;jenkins-hbase4:44231] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 18:01:54,877 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42067,1676570514371 2023-02-16 18:01:54,877 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 18:01:54,878 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55666, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 18:01:54,882 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-16 18:01:54,882 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 18:01:54,883 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42067%2C1676570514371.meta, suffix=.meta, logDir=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/WALs/jenkins-hbase4.apache.org,42067,1676570514371, archiveDir=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/oldWALs, maxLogs=32 2023-02-16 18:01:54,900 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38761,DS-34176839-717a-401f-908e-da8453bdbd9d,DISK] 2023-02-16 18:01:54,900 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44923,DS-356a2f68-07d4-4551-820c-6e810b402be3,DISK] 2023-02-16 18:01:54,902 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/WALs/jenkins-hbase4.apache.org,42067,1676570514371/jenkins-hbase4.apache.org%2C42067%2C1676570514371.meta.1676570514883.meta 2023-02-16 18:01:54,902 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38761,DS-34176839-717a-401f-908e-da8453bdbd9d,DISK], DatanodeInfoWithStorage[127.0.0.1:44923,DS-356a2f68-07d4-4551-820c-6e810b402be3,DISK]] 2023-02-16 18:01:54,902 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-16 18:01:54,902 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-16 18:01:54,902 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-16 18:01:54,902 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-16 18:01:54,903 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-16 18:01:54,903 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:54,903 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-16 18:01:54,903 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-16 18:01:54,904 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 18:01:54,904 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/hbase/meta/1588230740/info 2023-02-16 18:01:54,904 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/hbase/meta/1588230740/info 2023-02-16 18:01:54,905 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 18:01:54,905 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:54,905 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 18:01:54,906 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/hbase/meta/1588230740/rep_barrier 2023-02-16 18:01:54,906 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/hbase/meta/1588230740/rep_barrier 2023-02-16 18:01:54,906 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 18:01:54,907 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:54,907 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 18:01:54,907 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/hbase/meta/1588230740/table 2023-02-16 18:01:54,907 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/hbase/meta/1588230740/table 2023-02-16 18:01:54,908 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 18:01:54,908 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:54,908 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/hbase/meta/1588230740 2023-02-16 18:01:54,909 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/hbase/meta/1588230740 2023-02-16 18:01:54,910 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 18:01:54,911 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 18:01:54,912 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61777475, jitterRate=-0.07944388687610626}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 18:01:54,912 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 18:01:54,912 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676570514877 2023-02-16 18:01:54,915 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-16 18:01:54,916 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-16 18:01:54,916 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42067,1676570514371, state=OPEN 2023-02-16 18:01:54,917 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-16 18:01:54,917 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 18:01:54,919 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-16 18:01:54,919 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42067,1676570514371 in 224 msec 2023-02-16 18:01:54,920 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-16 18:01:54,920 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 397 msec 2023-02-16 18:01:54,921 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 429 msec 2023-02-16 18:01:54,921 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676570514921, completionTime=-1 2023-02-16 18:01:54,921 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-16 18:01:54,921 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-16 18:01:54,923 DEBUG [hconnection-0x505d3010-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 18:01:54,924 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55676, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 18:01:54,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-16 18:01:54,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676570574925 2023-02-16 18:01:54,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676570634925 2023-02-16 18:01:54,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 3 msec 2023-02-16 18:01:54,930 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41753,1676570514302-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:54,930 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41753,1676570514302-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:54,930 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41753,1676570514302-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:54,930 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:41753, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:54,930 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-16 18:01:54,930 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-16 18:01:54,930 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 18:01:54,931 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-16 18:01:54,932 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-16 18:01:54,932 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 18:01:54,933 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 18:01:54,934 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/.tmp/data/hbase/namespace/5f0a8b0757b12097ff67252faf851261 2023-02-16 18:01:54,935 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/.tmp/data/hbase/namespace/5f0a8b0757b12097ff67252faf851261 empty. 2023-02-16 18:01:54,935 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/.tmp/data/hbase/namespace/5f0a8b0757b12097ff67252faf851261 2023-02-16 18:01:54,935 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-16 18:01:54,945 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-16 18:01:54,946 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5f0a8b0757b12097ff67252faf851261, NAME => 'hbase:namespace,,1676570514930.5f0a8b0757b12097ff67252faf851261.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/.tmp 2023-02-16 18:01:54,955 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676570514930.5f0a8b0757b12097ff67252faf851261.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:54,955 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 18:01:54,955 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 5f0a8b0757b12097ff67252faf851261, disabling compactions & flushes 2023-02-16 18:01:54,955 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-16 18:01:54,955 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676570514930.5f0a8b0757b12097ff67252faf851261. 2023-02-16 18:01:54,955 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676570514930.5f0a8b0757b12097ff67252faf851261. 2023-02-16 18:01:54,955 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676570514930.5f0a8b0757b12097ff67252faf851261. after waiting 0 ms 2023-02-16 18:01:54,955 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676570514930.5f0a8b0757b12097ff67252faf851261. 2023-02-16 18:01:54,955 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676570514930.5f0a8b0757b12097ff67252faf851261. 2023-02-16 18:01:54,955 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 5f0a8b0757b12097ff67252faf851261: 2023-02-16 18:01:54,957 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 18:01:54,958 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676570514930.5f0a8b0757b12097ff67252faf851261.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676570514957"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570514957"}]},"ts":"1676570514957"} 2023-02-16 18:01:54,959 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 18:01:54,959 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 18:01:54,959 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676570514959"}]},"ts":"1676570514959"} 2023-02-16 18:01:54,960 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-16 18:01:54,963 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 18:01:54,964 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 18:01:54,964 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 18:01:54,964 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 18:01:54,964 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=5f0a8b0757b12097ff67252faf851261, ASSIGN}] 2023-02-16 18:01:54,968 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=5f0a8b0757b12097ff67252faf851261, ASSIGN 2023-02-16 18:01:54,969 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=5f0a8b0757b12097ff67252faf851261, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44231,1676570514346; forceNewPlan=false, retain=false 2023-02-16 18:01:55,119 INFO [jenkins-hbase4:41753] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 18:01:55,119 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=5f0a8b0757b12097ff67252faf851261, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:55,120 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676570514930.5f0a8b0757b12097ff67252faf851261.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676570515119"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570515119"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570515119"}]},"ts":"1676570515119"} 2023-02-16 18:01:55,121 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 5f0a8b0757b12097ff67252faf851261, server=jenkins-hbase4.apache.org,44231,1676570514346}] 2023-02-16 18:01:55,274 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:55,274 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 18:01:55,276 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39846, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 18:01:55,279 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676570514930.5f0a8b0757b12097ff67252faf851261. 2023-02-16 18:01:55,343 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44231%2C1676570514346, suffix=, logDir=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/WALs/jenkins-hbase4.apache.org,44231,1676570514346, archiveDir=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/oldWALs, maxLogs=32 2023-02-16 18:01:55,358 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44923,DS-356a2f68-07d4-4551-820c-6e810b402be3,DISK] 2023-02-16 18:01:55,358 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38761,DS-34176839-717a-401f-908e-da8453bdbd9d,DISK] 2023-02-16 18:01:55,360 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/WALs/jenkins-hbase4.apache.org,44231,1676570514346/jenkins-hbase4.apache.org%2C44231%2C1676570514346.1676570515344 2023-02-16 18:01:55,362 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44923,DS-356a2f68-07d4-4551-820c-6e810b402be3,DISK], DatanodeInfoWithStorage[127.0.0.1:38761,DS-34176839-717a-401f-908e-da8453bdbd9d,DISK]] 2023-02-16 18:01:55,362 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5f0a8b0757b12097ff67252faf851261, NAME => 'hbase:namespace,,1676570514930.5f0a8b0757b12097ff67252faf851261.', STARTKEY => '', ENDKEY => ''} 2023-02-16 18:01:55,362 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 5f0a8b0757b12097ff67252faf851261 2023-02-16 18:01:55,362 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676570514930.5f0a8b0757b12097ff67252faf851261.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:55,362 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5f0a8b0757b12097ff67252faf851261 2023-02-16 18:01:55,362 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5f0a8b0757b12097ff67252faf851261 2023-02-16 18:01:55,364 INFO [StoreOpener-5f0a8b0757b12097ff67252faf851261-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 5f0a8b0757b12097ff67252faf851261 2023-02-16 18:01:55,365 DEBUG [StoreOpener-5f0a8b0757b12097ff67252faf851261-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/hbase/namespace/5f0a8b0757b12097ff67252faf851261/info 2023-02-16 18:01:55,365 DEBUG [StoreOpener-5f0a8b0757b12097ff67252faf851261-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/hbase/namespace/5f0a8b0757b12097ff67252faf851261/info 2023-02-16 18:01:55,365 INFO [StoreOpener-5f0a8b0757b12097ff67252faf851261-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f0a8b0757b12097ff67252faf851261 columnFamilyName info 2023-02-16 18:01:55,366 INFO [StoreOpener-5f0a8b0757b12097ff67252faf851261-1] regionserver.HStore(310): Store=5f0a8b0757b12097ff67252faf851261/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:55,366 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/hbase/namespace/5f0a8b0757b12097ff67252faf851261 2023-02-16 18:01:55,367 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/hbase/namespace/5f0a8b0757b12097ff67252faf851261 2023-02-16 18:01:55,368 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5f0a8b0757b12097ff67252faf851261 2023-02-16 18:01:55,370 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/hbase/namespace/5f0a8b0757b12097ff67252faf851261/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:55,370 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5f0a8b0757b12097ff67252faf851261; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67434615, jitterRate=0.004854068160057068}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 18:01:55,370 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5f0a8b0757b12097ff67252faf851261: 2023-02-16 18:01:55,371 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676570514930.5f0a8b0757b12097ff67252faf851261., pid=6, masterSystemTime=1676570515274 2023-02-16 18:01:55,374 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676570514930.5f0a8b0757b12097ff67252faf851261. 2023-02-16 18:01:55,375 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676570514930.5f0a8b0757b12097ff67252faf851261. 2023-02-16 18:01:55,375 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=5f0a8b0757b12097ff67252faf851261, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:55,375 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676570514930.5f0a8b0757b12097ff67252faf851261.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676570515375"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676570515375"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676570515375"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676570515375"}]},"ts":"1676570515375"} 2023-02-16 18:01:55,377 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-16 18:01:55,377 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 5f0a8b0757b12097ff67252faf851261, server=jenkins-hbase4.apache.org,44231,1676570514346 in 255 msec 2023-02-16 18:01:55,378 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-16 18:01:55,379 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=5f0a8b0757b12097ff67252faf851261, ASSIGN in 413 msec 2023-02-16 18:01:55,379 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 18:01:55,379 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676570515379"}]},"ts":"1676570515379"} 2023-02-16 18:01:55,380 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-16 18:01:55,382 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 18:01:55,383 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 452 msec 2023-02-16 18:01:55,437 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-16 18:01:55,439 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-16 18:01:55,439 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:55,441 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 18:01:55,442 INFO [RS-EventLoopGroup-22-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39856, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 18:01:55,444 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-16 18:01:55,452 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 18:01:55,454 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-16 18:01:55,466 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-16 18:01:55,473 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 18:01:55,477 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 11 msec 2023-02-16 18:01:55,490 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-16 18:01:55,493 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-16 18:01:55,493 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.104sec 2023-02-16 18:01:55,494 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-16 18:01:55,494 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-16 18:01:55,494 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-16 18:01:55,494 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41753,1676570514302-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-16 18:01:55,494 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41753,1676570514302-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-16 18:01:55,496 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-16 18:01:55,538 DEBUG [Listener at localhost/33589] zookeeper.ReadOnlyZKClient(139): Connect 0x293cd9a3 to 127.0.0.1:59223 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 18:01:55,541 DEBUG [Listener at localhost/33589] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2befbdf4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 18:01:55,542 DEBUG [hconnection-0x227a7328-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 18:01:55,544 INFO [RS-EventLoopGroup-23-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55688, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 18:01:55,545 INFO [Listener at localhost/33589] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,41753,1676570514302 2023-02-16 18:01:55,545 DEBUG [Listener at localhost/33589] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-16 18:01:55,548 DEBUG [Listener at localhost/33589] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-16 18:01:55,549 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48692, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-16 18:01:55,550 INFO [Listener at localhost/33589] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-16 18:01:55,550 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-16 18:01:55,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-16 18:01:55,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:48692 deadline: 1676570575550, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-16 18:01:55,551 INFO [Listener at localhost/33589] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-16 18:01:55,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 18:01:55,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-16 18:01:55,555 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 18:01:55,556 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-16 18:01:55,556 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 18:01:55,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 18:01:55,557 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/.tmp/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f 2023-02-16 18:01:55,558 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/.tmp/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f empty. 2023-02-16 18:01:55,558 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/.tmp/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f 2023-02-16 18:01:55,558 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-16 18:01:55,566 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-16 18:01:55,568 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 2d6077041772212edbf56cade3798d6f, NAME => 'testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/.tmp 2023-02-16 18:01:55,573 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:55,573 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 2d6077041772212edbf56cade3798d6f, disabling compactions & flushes 2023-02-16 18:01:55,573 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f. 2023-02-16 18:01:55,573 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f. 2023-02-16 18:01:55,574 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f. after waiting 0 ms 2023-02-16 18:01:55,574 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f. 2023-02-16 18:01:55,574 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f. 2023-02-16 18:01:55,574 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 2d6077041772212edbf56cade3798d6f: 2023-02-16 18:01:55,575 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 18:01:55,576 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676570515576"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570515576"}]},"ts":"1676570515576"} 2023-02-16 18:01:55,578 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 18:01:55,578 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 18:01:55,579 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676570515578"}]},"ts":"1676570515578"} 2023-02-16 18:01:55,580 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-16 18:01:55,583 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 18:01:55,584 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 18:01:55,584 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 18:01:55,584 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 18:01:55,584 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2d6077041772212edbf56cade3798d6f, ASSIGN}] 2023-02-16 18:01:55,585 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2d6077041772212edbf56cade3798d6f, ASSIGN 2023-02-16 18:01:55,585 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=2d6077041772212edbf56cade3798d6f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44231,1676570514346; forceNewPlan=false, retain=false 2023-02-16 18:01:55,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 18:01:55,736 INFO [jenkins-hbase4:41753] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 18:01:55,736 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=2d6077041772212edbf56cade3798d6f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:55,736 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676570515736"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570515736"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570515736"}]},"ts":"1676570515736"} 2023-02-16 18:01:55,738 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 2d6077041772212edbf56cade3798d6f, server=jenkins-hbase4.apache.org,44231,1676570514346}] 2023-02-16 18:01:55,784 INFO [RS:1;jenkins-hbase4:42067] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42067%2C1676570514371, suffix=, logDir=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/WALs/jenkins-hbase4.apache.org,42067,1676570514371, archiveDir=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/oldWALs, maxLogs=32 2023-02-16 18:01:55,798 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44923,DS-356a2f68-07d4-4551-820c-6e810b402be3,DISK] 2023-02-16 18:01:55,798 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38761,DS-34176839-717a-401f-908e-da8453bdbd9d,DISK] 2023-02-16 18:01:55,799 INFO [RS:1;jenkins-hbase4:42067] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/WALs/jenkins-hbase4.apache.org,42067,1676570514371/jenkins-hbase4.apache.org%2C42067%2C1676570514371.1676570515785 2023-02-16 18:01:55,799 DEBUG [RS:1;jenkins-hbase4:42067] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44923,DS-356a2f68-07d4-4551-820c-6e810b402be3,DISK], DatanodeInfoWithStorage[127.0.0.1:38761,DS-34176839-717a-401f-908e-da8453bdbd9d,DISK]] 2023-02-16 18:01:55,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 18:01:55,892 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f. 2023-02-16 18:01:55,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2d6077041772212edbf56cade3798d6f, NAME => 'testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f.', STARTKEY => '', ENDKEY => ''} 2023-02-16 18:01:55,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 2d6077041772212edbf56cade3798d6f 2023-02-16 18:01:55,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:55,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2d6077041772212edbf56cade3798d6f 2023-02-16 18:01:55,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2d6077041772212edbf56cade3798d6f 2023-02-16 18:01:55,893 INFO [StoreOpener-2d6077041772212edbf56cade3798d6f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2d6077041772212edbf56cade3798d6f 2023-02-16 18:01:55,895 DEBUG [StoreOpener-2d6077041772212edbf56cade3798d6f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/f1 2023-02-16 18:01:55,895 DEBUG [StoreOpener-2d6077041772212edbf56cade3798d6f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/f1 2023-02-16 18:01:55,895 INFO [StoreOpener-2d6077041772212edbf56cade3798d6f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2d6077041772212edbf56cade3798d6f columnFamilyName f1 2023-02-16 18:01:55,895 INFO [StoreOpener-2d6077041772212edbf56cade3798d6f-1] regionserver.HStore(310): Store=2d6077041772212edbf56cade3798d6f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:55,895 INFO [StoreOpener-2d6077041772212edbf56cade3798d6f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2d6077041772212edbf56cade3798d6f 2023-02-16 18:01:55,896 DEBUG [StoreOpener-2d6077041772212edbf56cade3798d6f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/f2 2023-02-16 18:01:55,896 DEBUG [StoreOpener-2d6077041772212edbf56cade3798d6f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/f2 2023-02-16 18:01:55,897 INFO [StoreOpener-2d6077041772212edbf56cade3798d6f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2d6077041772212edbf56cade3798d6f columnFamilyName f2 2023-02-16 18:01:55,897 INFO [StoreOpener-2d6077041772212edbf56cade3798d6f-1] regionserver.HStore(310): Store=2d6077041772212edbf56cade3798d6f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:55,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f 2023-02-16 18:01:55,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f 2023-02-16 18:01:55,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:55,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2d6077041772212edbf56cade3798d6f 2023-02-16 18:01:55,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 18:01:55,902 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2d6077041772212edbf56cade3798d6f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73731504, jitterRate=0.09868502616882324}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:55,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2d6077041772212edbf56cade3798d6f: 2023-02-16 18:01:55,903 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f., pid=12, masterSystemTime=1676570515889 2023-02-16 18:01:55,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f. 2023-02-16 18:01:55,904 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f. 2023-02-16 18:01:55,905 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=2d6077041772212edbf56cade3798d6f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:55,905 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676570515905"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676570515905"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676570515905"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676570515905"}]},"ts":"1676570515905"} 2023-02-16 18:01:55,907 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-16 18:01:55,907 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 2d6077041772212edbf56cade3798d6f, server=jenkins-hbase4.apache.org,44231,1676570514346 in 168 msec 2023-02-16 18:01:55,908 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-16 18:01:55,909 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=2d6077041772212edbf56cade3798d6f, ASSIGN in 323 msec 2023-02-16 18:01:55,909 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 18:01:55,909 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676570515909"}]},"ts":"1676570515909"} 2023-02-16 18:01:55,910 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-16 18:01:55,912 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 18:01:55,913 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 359 msec 2023-02-16 18:01:56,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 18:01:56,162 INFO [Listener at localhost/33589] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-16 18:01:56,162 DEBUG [Listener at localhost/33589] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-16 18:01:56,162 INFO [Listener at localhost/33589] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 18:01:56,164 INFO [Listener at localhost/33589] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-16 18:01:56,164 INFO [Listener at localhost/33589] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 18:01:56,164 INFO [Listener at localhost/33589] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-16 18:01:56,164 INFO [Listener at localhost/33589] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-16 18:01:56,176 DEBUG [hconnection-0x227a7328-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 18:01:56,186 INFO [RS-EventLoopGroup-22-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39868, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 18:01:56,193 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44231] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f. 2023-02-16 18:01:56,279 INFO [Listener at localhost/33589] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-16 18:01:56,279 INFO [Listener at localhost/33589] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-16 18:01:56,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 18:01:56,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676570516280 (current time:1676570516280). 2023-02-16 18:01:56,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-16 18:01:56,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] zookeeper.ReadOnlyZKClient(139): Connect 0x6e1be1d2 to 127.0.0.1:59223 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 18:01:56,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@16fe1347, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 18:01:56,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 18:01:56,285 INFO [RS-EventLoopGroup-23-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55694, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 18:01:56,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6e1be1d2 to 127.0.0.1:59223 2023-02-16 18:01:56,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:56,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-16 18:01:56,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 18:01:56,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 18:01:56,289 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 18:01:56,290 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676571116290 2023-02-16 18:01:56,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 18:01:56,290 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-16 18:01:56,291 DEBUG [Listener at localhost/33589] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-16 18:01:56,291 DEBUG [Listener at localhost/33589] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-16 18:01:56,291 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 18:01:56,292 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 18:01:56,292 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 3 msec 2023-02-16 18:01:56,293 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 18:01:56,294 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676571116294 2023-02-16 18:01:56,300 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-16 18:01:56,300 INFO [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-16 18:01:56,300 DEBUG [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 18:01:56,301 DEBUG [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-16 18:01:56,301 DEBUG [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-16 18:01:56,302 DEBUG [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 18:01:56,302 DEBUG [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-16 18:01:56,304 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): regionserver:44231-0x1005e4bbd1f0001, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 18:01:56,304 DEBUG [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:56,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 18:01:56,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:56,304 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): regionserver:42067-0x1005e4bbd1f0002, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 18:01:56,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 18:01:56,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:56,304 DEBUG [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:56,304 DEBUG [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 18:01:56,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-16 18:01:56,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-16 18:01:56,305 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44231-0x1005e4bbd1f0001, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 18:01:56,305 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42067-0x1005e4bbd1f0002, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 18:01:56,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-16 18:01:56,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-16 18:01:56,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-16 18:01:56,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-16 18:01:56,305 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-16 18:01:56,305 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-16 18:01:56,305 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-16 18:01:56,305 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-16 18:01:56,305 DEBUG [member: 'jenkins-hbase4.apache.org,44231,1676570514346' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-16 18:01:56,306 DEBUG [member: 'jenkins-hbase4.apache.org,44231,1676570514346' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 18:01:56,306 DEBUG [member: 'jenkins-hbase4.apache.org,42067,1676570514371' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-16 18:01:56,306 DEBUG [member: 'jenkins-hbase4.apache.org,42067,1676570514371' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 18:01:56,306 DEBUG [member: 'jenkins-hbase4.apache.org,44231,1676570514346' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-16 18:01:56,308 DEBUG [member: 'jenkins-hbase4.apache.org,42067,1676570514371' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-16 18:01:56,308 DEBUG [member: 'jenkins-hbase4.apache.org,42067,1676570514371' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-16 18:01:56,308 DEBUG [member: 'jenkins-hbase4.apache.org,44231,1676570514346' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-16 18:01:56,308 DEBUG [member: 'jenkins-hbase4.apache.org,44231,1676570514346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44231,1676570514346' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-16 18:01:56,308 DEBUG [member: 'jenkins-hbase4.apache.org,42067,1676570514371' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42067,1676570514371' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-16 18:01:56,310 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:56,310 DEBUG [member: 'jenkins-hbase4.apache.org,44231,1676570514346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 18:01:56,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:56,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:56,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 18:01:56,310 DEBUG [member: 'jenkins-hbase4.apache.org,42067,1676570514371' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 18:01:56,310 DEBUG [member: 'jenkins-hbase4.apache.org,44231,1676570514346' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44231-0x1005e4bbd1f0001, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 18:01:56,310 DEBUG [member: 'jenkins-hbase4.apache.org,44231,1676570514346' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 18:01:56,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:56,310 DEBUG [member: 'jenkins-hbase4.apache.org,42067,1676570514371' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42067-0x1005e4bbd1f0002, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 18:01:56,310 DEBUG [member: 'jenkins-hbase4.apache.org,42067,1676570514371' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 18:01:56,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:56,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-16 18:01:56,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:56,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42067,1676570514371 2023-02-16 18:01:56,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:56,312 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44231,1676570514346' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-16 18:01:56,312 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@638ce4e5[Count = 0] remaining members to acquire global barrier 2023-02-16 18:01:56,312 DEBUG [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-16 18:01:56,312 DEBUG [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 18:01:56,313 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): regionserver:42067-0x1005e4bbd1f0002, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 18:01:56,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 18:01:56,313 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): regionserver:44231-0x1005e4bbd1f0001, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 18:01:56,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 18:01:56,313 DEBUG [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:56,313 DEBUG [member: 'jenkins-hbase4.apache.org,42067,1676570514371' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-16 18:01:56,313 DEBUG [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 18:01:56,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 18:01:56,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 18:01:56,313 DEBUG [member: 'jenkins-hbase4.apache.org,42067,1676570514371' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-16 18:01:56,313 DEBUG [member: 'jenkins-hbase4.apache.org,42067,1676570514371' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,42067,1676570514371' in zk 2023-02-16 18:01:56,313 DEBUG [member: 'jenkins-hbase4.apache.org,44231,1676570514346' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-16 18:01:56,313 DEBUG [member: 'jenkins-hbase4.apache.org,44231,1676570514346' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-16 18:01:56,313 DEBUG [member: 'jenkins-hbase4.apache.org,44231,1676570514346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 18:01:56,313 DEBUG [rs(jenkins-hbase4.apache.org,44231,1676570514346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f. 2023-02-16 18:01:56,314 DEBUG [rs(jenkins-hbase4.apache.org,44231,1676570514346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f. started... 2023-02-16 18:01:56,314 INFO [rs(jenkins-hbase4.apache.org,44231,1676570514346)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 2d6077041772212edbf56cade3798d6f 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-16 18:01:56,314 DEBUG [member: 'jenkins-hbase4.apache.org,42067,1676570514371' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-16 18:01:56,314 DEBUG [member: 'jenkins-hbase4.apache.org,42067,1676570514371' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:56,314 DEBUG [member: 'jenkins-hbase4.apache.org,42067,1676570514371' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-16 18:01:56,327 INFO [rs(jenkins-hbase4.apache.org,44231,1676570514346)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/.tmp/f1/991fbb9bd2ec451a875a4fcec9c73e1f 2023-02-16 18:01:56,346 INFO [rs(jenkins-hbase4.apache.org,44231,1676570514346)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/.tmp/f2/eaa7662c70e44871b5128f2f4555a272 2023-02-16 18:01:56,350 DEBUG [rs(jenkins-hbase4.apache.org,44231,1676570514346)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/.tmp/f1/991fbb9bd2ec451a875a4fcec9c73e1f as hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/f1/991fbb9bd2ec451a875a4fcec9c73e1f 2023-02-16 18:01:56,353 INFO [rs(jenkins-hbase4.apache.org,44231,1676570514346)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/f1/991fbb9bd2ec451a875a4fcec9c73e1f, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-16 18:01:56,354 DEBUG [rs(jenkins-hbase4.apache.org,44231,1676570514346)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/.tmp/f2/eaa7662c70e44871b5128f2f4555a272 as hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/f2/eaa7662c70e44871b5128f2f4555a272 2023-02-16 18:01:56,358 INFO [rs(jenkins-hbase4.apache.org,44231,1676570514346)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/f2/eaa7662c70e44871b5128f2f4555a272, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-16 18:01:56,358 INFO [rs(jenkins-hbase4.apache.org,44231,1676570514346)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 2d6077041772212edbf56cade3798d6f in 44ms, sequenceid=5, compaction requested=false 2023-02-16 18:01:56,358 DEBUG [rs(jenkins-hbase4.apache.org,44231,1676570514346)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 2d6077041772212edbf56cade3798d6f: 2023-02-16 18:01:56,359 DEBUG [rs(jenkins-hbase4.apache.org,44231,1676570514346)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-16 18:01:56,359 DEBUG [rs(jenkins-hbase4.apache.org,44231,1676570514346)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 18:01:56,359 DEBUG [rs(jenkins-hbase4.apache.org,44231,1676570514346)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/f1/991fbb9bd2ec451a875a4fcec9c73e1f] hfiles 2023-02-16 18:01:56,359 DEBUG [rs(jenkins-hbase4.apache.org,44231,1676570514346)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/f1/991fbb9bd2ec451a875a4fcec9c73e1f for snapshot=testWithMapReduceSingleRegion 2023-02-16 18:01:56,359 DEBUG [rs(jenkins-hbase4.apache.org,44231,1676570514346)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/f2/eaa7662c70e44871b5128f2f4555a272] hfiles 2023-02-16 18:01:56,359 DEBUG [rs(jenkins-hbase4.apache.org,44231,1676570514346)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/f2/eaa7662c70e44871b5128f2f4555a272 for snapshot=testWithMapReduceSingleRegion 2023-02-16 18:01:56,368 DEBUG [rs(jenkins-hbase4.apache.org,44231,1676570514346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f. completed. 2023-02-16 18:01:56,368 DEBUG [rs(jenkins-hbase4.apache.org,44231,1676570514346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f. 2023-02-16 18:01:56,368 DEBUG [member: 'jenkins-hbase4.apache.org,44231,1676570514346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-16 18:01:56,368 DEBUG [member: 'jenkins-hbase4.apache.org,44231,1676570514346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-16 18:01:56,368 DEBUG [member: 'jenkins-hbase4.apache.org,44231,1676570514346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:56,368 DEBUG [member: 'jenkins-hbase4.apache.org,44231,1676570514346' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-16 18:01:56,368 DEBUG [member: 'jenkins-hbase4.apache.org,44231,1676570514346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,44231,1676570514346' in zk 2023-02-16 18:01:56,371 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:56,371 DEBUG [member: 'jenkins-hbase4.apache.org,44231,1676570514346' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-16 18:01:56,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:56,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:56,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 18:01:56,371 DEBUG [member: 'jenkins-hbase4.apache.org,44231,1676570514346' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:56,371 DEBUG [member: 'jenkins-hbase4.apache.org,44231,1676570514346' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-16 18:01:56,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:56,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:56,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-16 18:01:56,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:56,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42067,1676570514371 2023-02-16 18:01:56,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:56,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-16 18:01:56,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:56,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42067,1676570514371 2023-02-16 18:01:56,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,44231,1676570514346': 2023-02-16 18:01:56,374 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44231,1676570514346' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-16 18:01:56,374 INFO [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-16 18:01:56,374 DEBUG [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 18:01:56,374 DEBUG [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 18:01:56,374 DEBUG [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-16 18:01:56,374 INFO [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-16 18:01:56,376 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 18:01:56,376 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): regionserver:44231-0x1005e4bbd1f0001, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 18:01:56,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 18:01:56,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:56,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 18:01:56,376 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): regionserver:42067-0x1005e4bbd1f0002, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 18:01:56,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 18:01:56,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 18:01:56,376 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): regionserver:44231-0x1005e4bbd1f0001, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 18:01:56,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 18:01:56,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:56,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 18:01:56,376 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): regionserver:42067-0x1005e4bbd1f0002, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 18:01:56,377 DEBUG [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:56,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 18:01:56,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:56,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 18:01:56,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:56,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-16 18:01:56,377 DEBUG [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,42067,1676570514371 2023-02-16 18:01:56,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 18:01:56,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 18:01:56,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:56,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-16 18:01:56,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:56,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42067,1676570514371 2023-02-16 18:01:56,379 DEBUG [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:56,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:56,379 DEBUG [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,42067,1676570514371 2023-02-16 18:01:56,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-16 18:01:56,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:56,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42067,1676570514371 2023-02-16 18:01:56,385 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,42067,1676570514371 2023-02-16 18:01:56,385 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): regionserver:42067-0x1005e4bbd1f0002, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 18:01:56,385 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): regionserver:44231-0x1005e4bbd1f0001, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 18:01:56,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 18:01:56,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 18:01:56,385 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-16 18:01:56,385 DEBUG [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:56,385 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-16 18:01:56,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:56,385 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): regionserver:44231-0x1005e4bbd1f0001, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 18:01:56,385 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): regionserver:42067-0x1005e4bbd1f0002, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 18:01:56,385 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-16 18:01:56,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 18:01:56,385 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:56,385 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-16 18:01:56,385 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,42067,1676570514371 2023-02-16 18:01:56,385 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 18:01:56,385 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:56,385 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 18:01:56,385 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 18:01:56,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 18:01:56,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:56,385 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-16 18:01:56,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 18:01:56,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 18:01:56,392 DEBUG [Listener at localhost/33589] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 18:01:56,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 18:01:56,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-16 18:01:56,393 DEBUG [Listener at localhost/33589] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-16 18:01:56,400 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-16 18:01:56,414 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-16 18:01:56,414 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-16 18:01:56,414 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-16 18:01:56,414 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676570516290Consolidate snapshot: testWithMapReduceSingleRegion at 1676570516385 (+95 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1676570516385Writing data manifest for testWithMapReduceSingleRegion at 1676570516387 (+2 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1676570516393 (+6 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1676570516414 (+21 ms) 2023-02-16 18:01:56,416 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 18:01:56,417 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 125 msec 2023-02-16 18:01:56,593 DEBUG [Listener at localhost/33589] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 18:01:56,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 18:01:56,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-16 18:01:56,594 INFO [Listener at localhost/33589] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-16 18:01:56,599 INFO [Listener at localhost/33589] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-16 18:01:56,605 INFO [Listener at localhost/33589] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-16 18:01:56,643 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44231] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f. 2023-02-16 18:01:56,725 INFO [Listener at localhost/33589] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-16 18:01:56,730 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-16 18:01:56,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-16 18:01:56,731 INFO [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-16 18:01:56,731 DEBUG [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 18:01:56,731 DEBUG [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-16 18:01:56,731 DEBUG [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-16 18:01:56,732 DEBUG [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:56,732 DEBUG [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 18:01:56,733 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): regionserver:44231-0x1005e4bbd1f0001, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 18:01:56,733 DEBUG [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:56,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 18:01:56,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:56,733 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): regionserver:42067-0x1005e4bbd1f0002, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 18:01:56,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 18:01:56,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:56,733 DEBUG [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:56,733 DEBUG [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 18:01:56,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 18:01:56,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 18:01:56,734 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44231-0x1005e4bbd1f0001, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:56,734 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42067-0x1005e4bbd1f0002, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:56,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 18:01:56,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 18:01:56,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 18:01:56,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 18:01:56,734 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-16 18:01:56,734 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-16 18:01:56,734 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-16 18:01:56,734 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-16 18:01:56,735 DEBUG [member: 'jenkins-hbase4.apache.org,44231,1676570514346' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-16 18:01:56,735 DEBUG [member: 'jenkins-hbase4.apache.org,44231,1676570514346' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 18:01:56,735 DEBUG [member: 'jenkins-hbase4.apache.org,42067,1676570514371' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-16 18:01:56,735 DEBUG [member: 'jenkins-hbase4.apache.org,44231,1676570514346' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-16 18:01:56,735 DEBUG [member: 'jenkins-hbase4.apache.org,42067,1676570514371' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 18:01:56,735 DEBUG [member: 'jenkins-hbase4.apache.org,42067,1676570514371' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-16 18:01:56,735 DEBUG [member: 'jenkins-hbase4.apache.org,42067,1676570514371' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-16 18:01:56,735 DEBUG [member: 'jenkins-hbase4.apache.org,42067,1676570514371' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42067,1676570514371' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-16 18:01:56,735 DEBUG [member: 'jenkins-hbase4.apache.org,44231,1676570514346' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-16 18:01:56,735 DEBUG [member: 'jenkins-hbase4.apache.org,44231,1676570514346' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 18:01:56,735 DEBUG [rs(jenkins-hbase4.apache.org,44231,1676570514346)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f. 2023-02-16 18:01:56,735 DEBUG [rs(jenkins-hbase4.apache.org,44231,1676570514346)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f. started... 2023-02-16 18:01:56,735 INFO [rs(jenkins-hbase4.apache.org,44231,1676570514346)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2d6077041772212edbf56cade3798d6f 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-16 18:01:56,736 DEBUG [member: 'jenkins-hbase4.apache.org,42067,1676570514371' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 18:01:56,736 DEBUG [member: 'jenkins-hbase4.apache.org,42067,1676570514371' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42067-0x1005e4bbd1f0002, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 18:01:56,736 DEBUG [member: 'jenkins-hbase4.apache.org,42067,1676570514371' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 18:01:56,749 INFO [rs(jenkins-hbase4.apache.org,44231,1676570514346)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/.tmp/f1/1581e264e8024944bb06aaff1679faba 2023-02-16 18:01:57,174 INFO [rs(jenkins-hbase4.apache.org,44231,1676570514346)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/.tmp/f2/8c1da658faa347d28a814d94fd073fe0 2023-02-16 18:01:57,180 DEBUG [rs(jenkins-hbase4.apache.org,44231,1676570514346)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/.tmp/f1/1581e264e8024944bb06aaff1679faba as hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/f1/1581e264e8024944bb06aaff1679faba 2023-02-16 18:01:57,184 INFO [rs(jenkins-hbase4.apache.org,44231,1676570514346)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/f1/1581e264e8024944bb06aaff1679faba, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-16 18:01:57,185 DEBUG [rs(jenkins-hbase4.apache.org,44231,1676570514346)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/.tmp/f2/8c1da658faa347d28a814d94fd073fe0 as hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/f2/8c1da658faa347d28a814d94fd073fe0 2023-02-16 18:01:57,190 INFO [rs(jenkins-hbase4.apache.org,44231,1676570514346)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/f2/8c1da658faa347d28a814d94fd073fe0, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-16 18:01:57,191 INFO [rs(jenkins-hbase4.apache.org,44231,1676570514346)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 2d6077041772212edbf56cade3798d6f in 456ms, sequenceid=9, compaction requested=false 2023-02-16 18:01:57,191 DEBUG [rs(jenkins-hbase4.apache.org,44231,1676570514346)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2d6077041772212edbf56cade3798d6f: 2023-02-16 18:01:57,191 DEBUG [rs(jenkins-hbase4.apache.org,44231,1676570514346)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f. 2023-02-16 18:01:57,191 DEBUG [member: 'jenkins-hbase4.apache.org,44231,1676570514346' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-16 18:01:57,191 DEBUG [member: 'jenkins-hbase4.apache.org,44231,1676570514346' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-16 18:01:57,191 DEBUG [member: 'jenkins-hbase4.apache.org,44231,1676570514346' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:57,191 DEBUG [member: 'jenkins-hbase4.apache.org,44231,1676570514346' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-16 18:01:57,191 DEBUG [member: 'jenkins-hbase4.apache.org,44231,1676570514346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44231,1676570514346' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-16 18:01:57,193 DEBUG [member: 'jenkins-hbase4.apache.org,44231,1676570514346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 18:01:57,193 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:57,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:57,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:57,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 18:01:57,194 DEBUG [member: 'jenkins-hbase4.apache.org,44231,1676570514346' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44231-0x1005e4bbd1f0001, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 18:01:57,194 DEBUG [member: 'jenkins-hbase4.apache.org,44231,1676570514346' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 18:01:57,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:57,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:57,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 18:01:57,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:57,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42067,1676570514371 2023-02-16 18:01:57,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:57,195 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44231,1676570514346' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-16 18:01:57,195 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67b36c4c[Count = 0] remaining members to acquire global barrier 2023-02-16 18:01:57,195 DEBUG [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-16 18:01:57,195 DEBUG [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 18:01:57,196 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): regionserver:42067-0x1005e4bbd1f0002, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 18:01:57,196 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): regionserver:44231-0x1005e4bbd1f0001, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 18:01:57,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 18:01:57,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 18:01:57,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 18:01:57,196 DEBUG [member: 'jenkins-hbase4.apache.org,44231,1676570514346' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-16 18:01:57,196 DEBUG [member: 'jenkins-hbase4.apache.org,44231,1676570514346' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-16 18:01:57,196 DEBUG [member: 'jenkins-hbase4.apache.org,44231,1676570514346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,44231,1676570514346' in zk 2023-02-16 18:01:57,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 18:01:57,196 DEBUG [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:57,197 DEBUG [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 18:01:57,197 DEBUG [member: 'jenkins-hbase4.apache.org,42067,1676570514371' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-16 18:01:57,197 DEBUG [member: 'jenkins-hbase4.apache.org,42067,1676570514371' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-16 18:01:57,197 DEBUG [member: 'jenkins-hbase4.apache.org,42067,1676570514371' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,42067,1676570514371' in zk 2023-02-16 18:01:57,198 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:57,198 DEBUG [member: 'jenkins-hbase4.apache.org,44231,1676570514346' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-16 18:01:57,198 DEBUG [member: 'jenkins-hbase4.apache.org,44231,1676570514346' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:57,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:57,198 DEBUG [member: 'jenkins-hbase4.apache.org,44231,1676570514346' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-16 18:01:57,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:57,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 18:01:57,199 DEBUG [member: 'jenkins-hbase4.apache.org,42067,1676570514371' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-16 18:01:57,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:57,199 DEBUG [member: 'jenkins-hbase4.apache.org,42067,1676570514371' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:57,199 DEBUG [member: 'jenkins-hbase4.apache.org,42067,1676570514371' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-16 18:01:57,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:57,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 18:01:57,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:57,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42067,1676570514371 2023-02-16 18:01:57,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:57,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 18:01:57,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:57,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42067,1676570514371 2023-02-16 18:01:57,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,44231,1676570514346': 2023-02-16 18:01:57,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44231,1676570514346' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-16 18:01:57,201 INFO [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-16 18:01:57,202 DEBUG [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 18:01:57,202 DEBUG [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 18:01:57,202 DEBUG [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-16 18:01:57,202 INFO [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-16 18:01:57,204 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:57,204 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): regionserver:44231-0x1005e4bbd1f0001, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:57,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:57,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 18:01:57,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 18:01:57,204 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): regionserver:42067-0x1005e4bbd1f0002, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:57,204 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): regionserver:44231-0x1005e4bbd1f0001, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 18:01:57,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:57,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:57,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:57,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 18:01:57,204 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): regionserver:42067-0x1005e4bbd1f0002, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 18:01:57,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:57,204 DEBUG [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:57,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 18:01:57,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:57,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 18:01:57,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 18:01:57,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:57,205 DEBUG [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42067,1676570514371 2023-02-16 18:01:57,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:57,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 18:01:57,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:57,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 18:01:57,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:57,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42067,1676570514371 2023-02-16 18:01:57,206 DEBUG [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:57,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 18:01:57,206 DEBUG [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42067,1676570514371 2023-02-16 18:01:57,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 18:01:57,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:57,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42067,1676570514371 2023-02-16 18:01:57,208 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42067,1676570514371 2023-02-16 18:01:57,209 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 18:01:57,209 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): regionserver:44231-0x1005e4bbd1f0001, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 18:01:57,209 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:57,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 18:01:57,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-16 18:01:57,209 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): regionserver:44231-0x1005e4bbd1f0001, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 18:01:57,209 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): regionserver:42067-0x1005e4bbd1f0002, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 18:01:57,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-16 18:01:57,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 18:01:57,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:57,209 DEBUG [(jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 18:01:57,209 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 18:01:57,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 18:01:57,209 DEBUG [Listener at localhost/33589] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-16 18:01:57,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 18:01:57,209 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): regionserver:42067-0x1005e4bbd1f0002, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 18:01:57,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:57,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 18:01:57,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 18:01:57,209 DEBUG [Listener at localhost/33589] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-16 18:01:57,209 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42067,1676570514371 2023-02-16 18:01:57,210 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 18:01:57,210 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:57,210 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 18:01:57,210 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 18:01:57,310 DEBUG [Listener at localhost/33589] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-16 18:01:57,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-16 18:01:57,398 DEBUG [Listener at localhost/33589] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/944328f3-acc6-4077-0b2f-eb3e984b25b3/hadoop-816577176223501895.jar 2023-02-16 18:01:57,402 INFO [Listener at localhost/33589] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676570516280 type: FLUSH version: 2 ttl: 0 2023-02-16 18:01:57,402 DEBUG [Listener at localhost/33589] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:43359/user/jenkins/test-data/da346747-dbe0-3b30-6e66-9d138f9d88f8/testWithMapReduceSingleRegion/b94c6d13-521f-4e94-8299-44bc9f41f8d9/data/default/testWithMapReduce 2023-02-16 18:01:57,402 INFO [Listener at localhost/33589] snapshot.RestoreSnapshotHelper(239): region to add: 2d6077041772212edbf56cade3798d6f 2023-02-16 18:01:57,402 INFO [Listener at localhost/33589] snapshot.RestoreSnapshotHelper(585): clone region=2d6077041772212edbf56cade3798d6f as 2d6077041772212edbf56cade3798d6f in snapshot testWithMapReduceSingleRegion 2023-02-16 18:01:57,403 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 2d6077041772212edbf56cade3798d6f, NAME => 'testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43359/user/jenkins/test-data/da346747-dbe0-3b30-6e66-9d138f9d88f8/testWithMapReduceSingleRegion/b94c6d13-521f-4e94-8299-44bc9f41f8d9 2023-02-16 18:01:57,408 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:57,409 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 991fbb9bd2ec451a875a4fcec9c73e1f from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-16 18:01:57,410 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink eaa7662c70e44871b5128f2f4555a272 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-16 18:01:57,412 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 2d6077041772212edbf56cade3798d6f, disabling compactions & flushes 2023-02-16 18:01:57,412 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f. 2023-02-16 18:01:57,412 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f. 2023-02-16 18:01:57,412 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f. after waiting 0 ms 2023-02-16 18:01:57,412 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f. 2023-02-16 18:01:57,412 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f. 2023-02-16 18:01:57,412 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 2d6077041772212edbf56cade3798d6f: 2023-02-16 18:01:57,412 INFO [Listener at localhost/33589] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676570516280 type: FLUSH version: 2 ttl: 0 2023-02-16 18:01:57,413 DEBUG [Listener at localhost/33589] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:43359/user/jenkins/test-data/da346747-dbe0-3b30-6e66-9d138f9d88f8/testWithMapReduceSingleRegion/b94c6d13-521f-4e94-8299-44bc9f41f8d9 2023-02-16 18:01:57,413 DEBUG [Listener at localhost/33589] util.CommonFSUtils(682): File system contents for path hdfs://localhost:43359/user/jenkins/test-data/da346747-dbe0-3b30-6e66-9d138f9d88f8/testWithMapReduceSingleRegion/b94c6d13-521f-4e94-8299-44bc9f41f8d9 2023-02-16 18:01:57,413 DEBUG [Listener at localhost/33589] util.CommonFSUtils(699): |-data/ 2023-02-16 18:01:57,413 DEBUG [Listener at localhost/33589] util.CommonFSUtils(699): |----default/ 2023-02-16 18:01:57,414 DEBUG [Listener at localhost/33589] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-16 18:01:57,414 DEBUG [Listener at localhost/33589] util.CommonFSUtils(699): |----------2d6077041772212edbf56cade3798d6f/ 2023-02-16 18:01:57,414 DEBUG [Listener at localhost/33589] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 18:01:57,415 DEBUG [Listener at localhost/33589] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 18:01:57,415 DEBUG [Listener at localhost/33589] util.CommonFSUtils(702): |----------------testWithMapReduce=2d6077041772212edbf56cade3798d6f-991fbb9bd2ec451a875a4fcec9c73e1f 2023-02-16 18:01:57,415 DEBUG [Listener at localhost/33589] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 18:01:57,415 DEBUG [Listener at localhost/33589] util.CommonFSUtils(702): |----------------testWithMapReduce=2d6077041772212edbf56cade3798d6f-eaa7662c70e44871b5128f2f4555a272 2023-02-16 18:01:57,416 DEBUG [Listener at localhost/33589] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:57,416 DEBUG [Listener at localhost/33589] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:57,416 DEBUG [Listener at localhost/33589] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:57,417 DEBUG [Listener at localhost/33589] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:57,417 DEBUG [Listener at localhost/33589] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:57,417 DEBUG [Listener at localhost/33589] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:57,417 DEBUG [Listener at localhost/33589] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:57,483 DEBUG [Listener at localhost/33589] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/944328f3-acc6-4077-0b2f-eb3e984b25b3/hadoop-5612267723221400780.jar 2023-02-16 18:01:57,483 DEBUG [Listener at localhost/33589] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:57,483 DEBUG [Listener at localhost/33589] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:57,484 DEBUG [Listener at localhost/33589] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:57,484 DEBUG [Listener at localhost/33589] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:57,484 DEBUG [Listener at localhost/33589] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:57,485 DEBUG [Listener at localhost/33589] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:57,485 DEBUG [Listener at localhost/33589] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-16 18:01:57,485 DEBUG [Listener at localhost/33589] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-16 18:01:57,486 DEBUG [Listener at localhost/33589] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-16 18:01:57,486 DEBUG [Listener at localhost/33589] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-16 18:01:57,486 DEBUG [Listener at localhost/33589] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-16 18:01:57,487 DEBUG [Listener at localhost/33589] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-16 18:01:57,487 DEBUG [Listener at localhost/33589] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-16 18:01:57,487 DEBUG [Listener at localhost/33589] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-16 18:01:57,488 DEBUG [Listener at localhost/33589] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-16 18:01:57,488 DEBUG [Listener at localhost/33589] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-16 18:01:57,488 DEBUG [Listener at localhost/33589] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-16 18:01:57,489 DEBUG [Listener at localhost/33589] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 18:01:57,489 DEBUG [Listener at localhost/33589] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 18:01:57,489 DEBUG [Listener at localhost/33589] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 18:01:57,489 DEBUG [Listener at localhost/33589] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-16 18:01:57,557 DEBUG [Listener at localhost/33589] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/944328f3-acc6-4077-0b2f-eb3e984b25b3/hadoop-6266498032731095373.jar 2023-02-16 18:01:57,558 DEBUG [Listener at localhost/33589] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-16 18:01:57,563 WARN [Listener at localhost/33589] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-16 18:01:57,601 INFO [Listener at localhost/33589] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-16 18:01:57,691 WARN [Listener at localhost/33589] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/944328f3-acc6-4077-0b2f-eb3e984b25b3/mapreduce.cluster.local.dir/1676570517657/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-16 18:01:57,691 WARN [Listener at localhost/33589] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/944328f3-acc6-4077-0b2f-eb3e984b25b3/mapreduce.cluster.local.dir/1676570517657/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-16 18:01:57,721 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 18:01:57,721 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 18:01:57,721 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 18:01:57,723 INFO [StoreOpener-2d6077041772212edbf56cade3798d6f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2d6077041772212edbf56cade3798d6f 2023-02-16 18:01:57,724 DEBUG [StoreOpener-2d6077041772212edbf56cade3798d6f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43359/user/jenkins/test-data/da346747-dbe0-3b30-6e66-9d138f9d88f8/testWithMapReduceSingleRegion/b94c6d13-521f-4e94-8299-44bc9f41f8d9/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/f1 2023-02-16 18:01:57,724 INFO [StoreOpener-2d6077041772212edbf56cade3798d6f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2d6077041772212edbf56cade3798d6f columnFamilyName f1 2023-02-16 18:01:57,728 DEBUG [StoreOpener-2d6077041772212edbf56cade3798d6f-1] regionserver.HStore(539): loaded hdfs://localhost:43359/user/jenkins/test-data/da346747-dbe0-3b30-6e66-9d138f9d88f8/testWithMapReduceSingleRegion/b94c6d13-521f-4e94-8299-44bc9f41f8d9/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/f1/testWithMapReduce=2d6077041772212edbf56cade3798d6f-991fbb9bd2ec451a875a4fcec9c73e1f 2023-02-16 18:01:57,728 INFO [StoreOpener-2d6077041772212edbf56cade3798d6f-1] regionserver.HStore(310): Store=2d6077041772212edbf56cade3798d6f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:57,728 INFO [StoreOpener-2d6077041772212edbf56cade3798d6f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2d6077041772212edbf56cade3798d6f 2023-02-16 18:01:57,729 DEBUG [StoreOpener-2d6077041772212edbf56cade3798d6f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43359/user/jenkins/test-data/da346747-dbe0-3b30-6e66-9d138f9d88f8/testWithMapReduceSingleRegion/b94c6d13-521f-4e94-8299-44bc9f41f8d9/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/f2 2023-02-16 18:01:57,729 INFO [StoreOpener-2d6077041772212edbf56cade3798d6f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2d6077041772212edbf56cade3798d6f columnFamilyName f2 2023-02-16 18:01:57,732 DEBUG [StoreOpener-2d6077041772212edbf56cade3798d6f-1] regionserver.HStore(539): loaded hdfs://localhost:43359/user/jenkins/test-data/da346747-dbe0-3b30-6e66-9d138f9d88f8/testWithMapReduceSingleRegion/b94c6d13-521f-4e94-8299-44bc9f41f8d9/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/f2/testWithMapReduce=2d6077041772212edbf56cade3798d6f-eaa7662c70e44871b5128f2f4555a272 2023-02-16 18:01:57,732 INFO [StoreOpener-2d6077041772212edbf56cade3798d6f-1] regionserver.HStore(310): Store=2d6077041772212edbf56cade3798d6f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 18:01:57,732 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 18:01:57,732 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 2d6077041772212edbf56cade3798d6f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66746258, jitterRate=-0.005403250455856323}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 18:01:57,732 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 2d6077041772212edbf56cade3798d6f: 2023-02-16 18:01:57,855 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 2d6077041772212edbf56cade3798d6f, disabling compactions & flushes 2023-02-16 18:01:57,855 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f. 2023-02-16 18:01:57,855 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f. 2023-02-16 18:01:57,855 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f. after waiting 0 ms 2023-02-16 18:01:57,855 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f. 2023-02-16 18:01:57,856 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f. 2023-02-16 18:01:57,856 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 2d6077041772212edbf56cade3798d6f: 2023-02-16 18:01:58,120 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-16 18:01:58,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceSingleRegion" 2023-02-16 18:01:58,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-16 18:01:58,736 INFO [Listener at localhost/33589] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-16 18:01:58,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-16 18:01:58,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-16 18:01:58,739 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676570518739"}]},"ts":"1676570518739"} 2023-02-16 18:01:58,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 18:01:58,747 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-16 18:01:58,749 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-16 18:01:58,750 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=2d6077041772212edbf56cade3798d6f, UNASSIGN}] 2023-02-16 18:01:58,750 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=2d6077041772212edbf56cade3798d6f, UNASSIGN 2023-02-16 18:01:58,751 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=2d6077041772212edbf56cade3798d6f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:58,751 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676570518751"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676570518751"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676570518751"}]},"ts":"1676570518751"} 2023-02-16 18:01:58,752 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 2d6077041772212edbf56cade3798d6f, server=jenkins-hbase4.apache.org,44231,1676570514346}] 2023-02-16 18:01:58,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 18:01:58,906 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 2d6077041772212edbf56cade3798d6f 2023-02-16 18:01:58,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2d6077041772212edbf56cade3798d6f, disabling compactions & flushes 2023-02-16 18:01:58,906 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f. 2023-02-16 18:01:58,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f. 2023-02-16 18:01:58,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f. after waiting 0 ms 2023-02-16 18:01:58,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f. 2023-02-16 18:01:58,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 18:01:58,910 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f. 2023-02-16 18:01:58,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2d6077041772212edbf56cade3798d6f: 2023-02-16 18:01:58,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 2d6077041772212edbf56cade3798d6f 2023-02-16 18:01:58,912 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=2d6077041772212edbf56cade3798d6f, regionState=CLOSED 2023-02-16 18:01:58,912 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676570518912"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676570518912"}]},"ts":"1676570518912"} 2023-02-16 18:01:58,914 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-16 18:01:58,914 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 2d6077041772212edbf56cade3798d6f, server=jenkins-hbase4.apache.org,44231,1676570514346 in 161 msec 2023-02-16 18:01:58,915 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-16 18:01:58,915 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=2d6077041772212edbf56cade3798d6f, UNASSIGN in 164 msec 2023-02-16 18:01:58,916 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676570518915"}]},"ts":"1676570518915"} 2023-02-16 18:01:58,916 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-16 18:01:58,919 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-16 18:01:58,920 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 183 msec 2023-02-16 18:01:59,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 18:01:59,042 INFO [Listener at localhost/33589] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-16 18:01:59,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-16 18:01:59,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-16 18:01:59,045 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 18:01:59,046 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 18:01:59,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-16 18:01:59,048 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/.tmp/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f 2023-02-16 18:01:59,050 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/.tmp/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/f1, FileablePath, hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/.tmp/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/f2, FileablePath, hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/.tmp/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/recovered.edits] 2023-02-16 18:01:59,052 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/.tmp/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/f1/1581e264e8024944bb06aaff1679faba to hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/archive/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/f1/1581e264e8024944bb06aaff1679faba 2023-02-16 18:01:59,053 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/.tmp/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/f1/991fbb9bd2ec451a875a4fcec9c73e1f to hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/archive/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/f1/991fbb9bd2ec451a875a4fcec9c73e1f 2023-02-16 18:01:59,055 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/.tmp/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/f2/8c1da658faa347d28a814d94fd073fe0 to hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/archive/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/f2/8c1da658faa347d28a814d94fd073fe0 2023-02-16 18:01:59,056 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/.tmp/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/f2/eaa7662c70e44871b5128f2f4555a272 to hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/archive/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/f2/eaa7662c70e44871b5128f2f4555a272 2023-02-16 18:01:59,058 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/.tmp/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/recovered.edits/12.seqid to hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/archive/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f/recovered.edits/12.seqid 2023-02-16 18:01:59,058 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/.tmp/data/default/testWithMapReduce/2d6077041772212edbf56cade3798d6f 2023-02-16 18:01:59,058 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-16 18:01:59,060 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 18:01:59,061 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-16 18:01:59,062 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-16 18:01:59,063 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 18:01:59,063 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-16 18:01:59,063 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676570519063"}]},"ts":"9223372036854775807"} 2023-02-16 18:01:59,065 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-16 18:01:59,065 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2d6077041772212edbf56cade3798d6f, NAME => 'testWithMapReduce,,1676570515553.2d6077041772212edbf56cade3798d6f.', STARTKEY => '', ENDKEY => ''}] 2023-02-16 18:01:59,065 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-16 18:01:59,065 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676570519065"}]},"ts":"9223372036854775807"} 2023-02-16 18:01:59,066 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-16 18:01:59,067 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 18:01:59,068 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 24 msec 2023-02-16 18:01:59,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41753] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-16 18:01:59,148 INFO [Listener at localhost/33589] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-16 18:01:59,148 INFO [Listener at localhost/33589] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-16 18:01:59,148 INFO [Listener at localhost/33589] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-16 18:01:59,148 DEBUG [Listener at localhost/33589] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x293cd9a3 to 127.0.0.1:59223 2023-02-16 18:01:59,149 DEBUG [Listener at localhost/33589] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:59,149 DEBUG [Listener at localhost/33589] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-16 18:01:59,149 DEBUG [Listener at localhost/33589] util.JVMClusterUtil(257): Found active master hash=215725768, stopped=false 2023-02-16 18:01:59,149 INFO [Listener at localhost/33589] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,41753,1676570514302 2023-02-16 18:01:59,151 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): regionserver:42067-0x1005e4bbd1f0002, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:59,151 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): regionserver:44231-0x1005e4bbd1f0001, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:59,151 INFO [Listener at localhost/33589] procedure2.ProcedureExecutor(629): Stopping 2023-02-16 18:01:59,151 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 18:01:59,151 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:59,151 DEBUG [Listener at localhost/33589] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x664ecd67 to 127.0.0.1:59223 2023-02-16 18:01:59,151 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44231-0x1005e4bbd1f0001, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:59,151 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42067-0x1005e4bbd1f0002, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:59,153 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 18:01:59,151 DEBUG [Listener at localhost/33589] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:59,154 INFO [Listener at localhost/33589] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44231,1676570514346' ***** 2023-02-16 18:01:59,154 INFO [Listener at localhost/33589] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 18:01:59,154 INFO [Listener at localhost/33589] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42067,1676570514371' ***** 2023-02-16 18:01:59,154 INFO [Listener at localhost/33589] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 18:01:59,154 INFO [RS:1;jenkins-hbase4:42067] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 18:01:59,154 INFO [RS:1;jenkins-hbase4:42067] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 18:01:59,154 INFO [RS:1;jenkins-hbase4:42067] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 18:01:59,154 INFO [RS:0;jenkins-hbase4:44231] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 18:01:59,154 INFO [RS:1;jenkins-hbase4:42067] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42067,1676570514371 2023-02-16 18:01:59,154 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 18:01:59,154 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 18:01:59,154 DEBUG [RS:1;jenkins-hbase4:42067] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a1c9f45 to 127.0.0.1:59223 2023-02-16 18:01:59,154 INFO [RS:0;jenkins-hbase4:44231] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 18:01:59,156 DEBUG [RS:1;jenkins-hbase4:42067] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:59,156 INFO [RS:1;jenkins-hbase4:42067] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 18:01:59,156 INFO [RS:1;jenkins-hbase4:42067] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 18:01:59,156 INFO [RS:1;jenkins-hbase4:42067] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 18:01:59,157 INFO [RS:1;jenkins-hbase4:42067] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-16 18:01:59,156 INFO [RS:0;jenkins-hbase4:44231] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 18:01:59,157 INFO [RS:0;jenkins-hbase4:44231] regionserver.HRegionServer(3304): Received CLOSE for 5f0a8b0757b12097ff67252faf851261 2023-02-16 18:01:59,157 INFO [RS:0;jenkins-hbase4:44231] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:59,157 INFO [RS:1;jenkins-hbase4:42067] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-16 18:01:59,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5f0a8b0757b12097ff67252faf851261, disabling compactions & flushes 2023-02-16 18:01:59,157 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 18:01:59,157 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676570514930.5f0a8b0757b12097ff67252faf851261. 2023-02-16 18:01:59,157 DEBUG [RS:0;jenkins-hbase4:44231] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a18d62e to 127.0.0.1:59223 2023-02-16 18:01:59,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676570514930.5f0a8b0757b12097ff67252faf851261. 2023-02-16 18:01:59,157 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 18:01:59,157 DEBUG [RS:1;jenkins-hbase4:42067] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-16 18:01:59,157 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 18:01:59,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676570514930.5f0a8b0757b12097ff67252faf851261. after waiting 0 ms 2023-02-16 18:01:59,157 DEBUG [RS:0;jenkins-hbase4:44231] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:59,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676570514930.5f0a8b0757b12097ff67252faf851261. 2023-02-16 18:01:59,157 INFO [RS:0;jenkins-hbase4:44231] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-16 18:01:59,157 DEBUG [RS:1;jenkins-hbase4:42067] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-16 18:01:59,157 DEBUG [RS:0;jenkins-hbase4:44231] regionserver.HRegionServer(1479): Online Regions={5f0a8b0757b12097ff67252faf851261=hbase:namespace,,1676570514930.5f0a8b0757b12097ff67252faf851261.} 2023-02-16 18:01:59,157 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 18:01:59,157 DEBUG [RS:0;jenkins-hbase4:44231] regionserver.HRegionServer(1505): Waiting on 5f0a8b0757b12097ff67252faf851261 2023-02-16 18:01:59,157 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 18:01:59,157 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 5f0a8b0757b12097ff67252faf851261 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-16 18:01:59,158 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.70 KB heapSize=7.12 KB 2023-02-16 18:01:59,165 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/hbase/namespace/5f0a8b0757b12097ff67252faf851261/.tmp/info/b8e3329ccd73402fbbec937b5d38ad7d 2023-02-16 18:01:59,165 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/hbase/meta/1588230740/.tmp/info/02e6126470884108a4a2ac24a9e81dff 2023-02-16 18:01:59,171 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 02e6126470884108a4a2ac24a9e81dff 2023-02-16 18:01:59,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/hbase/namespace/5f0a8b0757b12097ff67252faf851261/.tmp/info/b8e3329ccd73402fbbec937b5d38ad7d as hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/hbase/namespace/5f0a8b0757b12097ff67252faf851261/info/b8e3329ccd73402fbbec937b5d38ad7d 2023-02-16 18:01:59,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/hbase/namespace/5f0a8b0757b12097ff67252faf851261/info/b8e3329ccd73402fbbec937b5d38ad7d, entries=2, sequenceid=6, filesize=4.8 K 2023-02-16 18:01:59,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 5f0a8b0757b12097ff67252faf851261 in 19ms, sequenceid=6, compaction requested=false 2023-02-16 18:01:59,179 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/hbase/meta/1588230740/.tmp/rep_barrier/b6629ba8fa4d407cb6417873d168eee5 2023-02-16 18:01:59,180 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/hbase/namespace/5f0a8b0757b12097ff67252faf851261/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-16 18:01:59,182 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 18:01:59,182 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676570514930.5f0a8b0757b12097ff67252faf851261. 2023-02-16 18:01:59,182 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 18:01:59,183 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5f0a8b0757b12097ff67252faf851261: 2023-02-16 18:01:59,183 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676570514930.5f0a8b0757b12097ff67252faf851261. 2023-02-16 18:01:59,185 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b6629ba8fa4d407cb6417873d168eee5 2023-02-16 18:01:59,191 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/hbase/meta/1588230740/.tmp/table/8d34847c3d244b0caa50aa9e6b3907e3 2023-02-16 18:01:59,194 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8d34847c3d244b0caa50aa9e6b3907e3 2023-02-16 18:01:59,194 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/hbase/meta/1588230740/.tmp/info/02e6126470884108a4a2ac24a9e81dff as hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/hbase/meta/1588230740/info/02e6126470884108a4a2ac24a9e81dff 2023-02-16 18:01:59,197 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 02e6126470884108a4a2ac24a9e81dff 2023-02-16 18:01:59,197 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/hbase/meta/1588230740/info/02e6126470884108a4a2ac24a9e81dff, entries=12, sequenceid=21, filesize=6.2 K 2023-02-16 18:01:59,198 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/hbase/meta/1588230740/.tmp/rep_barrier/b6629ba8fa4d407cb6417873d168eee5 as hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/hbase/meta/1588230740/rep_barrier/b6629ba8fa4d407cb6417873d168eee5 2023-02-16 18:01:59,201 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b6629ba8fa4d407cb6417873d168eee5 2023-02-16 18:01:59,201 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/hbase/meta/1588230740/rep_barrier/b6629ba8fa4d407cb6417873d168eee5, entries=1, sequenceid=21, filesize=5.0 K 2023-02-16 18:01:59,202 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/hbase/meta/1588230740/.tmp/table/8d34847c3d244b0caa50aa9e6b3907e3 as hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/hbase/meta/1588230740/table/8d34847c3d244b0caa50aa9e6b3907e3 2023-02-16 18:01:59,204 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8d34847c3d244b0caa50aa9e6b3907e3 2023-02-16 18:01:59,204 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/hbase/meta/1588230740/table/8d34847c3d244b0caa50aa9e6b3907e3, entries=4, sequenceid=21, filesize=5.0 K 2023-02-16 18:01:59,205 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 47ms, sequenceid=21, compaction requested=false 2023-02-16 18:01:59,208 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-16 18:01:59,208 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 18:01:59,209 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 18:01:59,209 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 18:01:59,209 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-16 18:01:59,357 INFO [RS:1;jenkins-hbase4:42067] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42067,1676570514371; all regions closed. 2023-02-16 18:01:59,358 INFO [RS:0;jenkins-hbase4:44231] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44231,1676570514346; all regions closed. 2023-02-16 18:01:59,361 DEBUG [RS:1;jenkins-hbase4:42067] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/oldWALs 2023-02-16 18:01:59,361 DEBUG [RS:0;jenkins-hbase4:44231] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/oldWALs 2023-02-16 18:01:59,361 INFO [RS:0;jenkins-hbase4:44231] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44231%2C1676570514346:(num 1676570515344) 2023-02-16 18:01:59,361 INFO [RS:1;jenkins-hbase4:42067] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42067%2C1676570514371.meta:.meta(num 1676570514883) 2023-02-16 18:01:59,361 DEBUG [RS:0;jenkins-hbase4:44231] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:59,362 INFO [RS:0;jenkins-hbase4:44231] regionserver.LeaseManager(133): Closed leases 2023-02-16 18:01:59,362 INFO [RS:0;jenkins-hbase4:44231] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-16 18:01:59,362 INFO [RS:0;jenkins-hbase4:44231] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 18:01:59,362 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 18:01:59,362 INFO [RS:0;jenkins-hbase4:44231] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 18:01:59,362 INFO [RS:0;jenkins-hbase4:44231] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 18:01:59,363 INFO [RS:0;jenkins-hbase4:44231] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44231 2023-02-16 18:01:59,365 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:59,365 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): regionserver:44231-0x1005e4bbd1f0001, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:59,365 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): regionserver:44231-0x1005e4bbd1f0001, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:59,366 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): regionserver:42067-0x1005e4bbd1f0002, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44231,1676570514346 2023-02-16 18:01:59,366 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): regionserver:42067-0x1005e4bbd1f0002, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:59,366 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44231,1676570514346] 2023-02-16 18:01:59,366 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44231,1676570514346; numProcessing=1 2023-02-16 18:01:59,367 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/WALs/jenkins-hbase4.apache.org,42067,1676570514371/jenkins-hbase4.apache.org%2C42067%2C1676570514371.1676570515785 not finished, retry = 0 2023-02-16 18:01:59,368 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44231,1676570514346 already deleted, retry=false 2023-02-16 18:01:59,368 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44231,1676570514346 expired; onlineServers=1 2023-02-16 18:01:59,469 DEBUG [RS:1;jenkins-hbase4:42067] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/oldWALs 2023-02-16 18:01:59,469 INFO [RS:1;jenkins-hbase4:42067] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42067%2C1676570514371:(num 1676570515785) 2023-02-16 18:01:59,469 DEBUG [RS:1;jenkins-hbase4:42067] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:59,469 INFO [RS:1;jenkins-hbase4:42067] regionserver.LeaseManager(133): Closed leases 2023-02-16 18:01:59,470 INFO [RS:1;jenkins-hbase4:42067] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-16 18:01:59,470 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 18:01:59,472 INFO [RS:1;jenkins-hbase4:42067] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42067 2023-02-16 18:01:59,474 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 18:01:59,474 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): regionserver:42067-0x1005e4bbd1f0002, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42067,1676570514371 2023-02-16 18:01:59,474 ERROR [Listener at localhost/33589-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2fa4fb1f rejected from java.util.concurrent.ThreadPoolExecutor@2b9b6a33[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:59,475 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42067,1676570514371] 2023-02-16 18:01:59,475 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42067,1676570514371; numProcessing=2 2023-02-16 18:01:59,477 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42067,1676570514371 already deleted, retry=false 2023-02-16 18:01:59,477 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42067,1676570514371 expired; onlineServers=0 2023-02-16 18:01:59,477 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41753,1676570514302' ***** 2023-02-16 18:01:59,477 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-16 18:01:59,478 DEBUG [M:0;jenkins-hbase4:41753] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8e4338b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 18:01:59,478 INFO [M:0;jenkins-hbase4:41753] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41753,1676570514302 2023-02-16 18:01:59,478 INFO [M:0;jenkins-hbase4:41753] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41753,1676570514302; all regions closed. 2023-02-16 18:01:59,478 DEBUG [M:0;jenkins-hbase4:41753] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 18:01:59,478 DEBUG [M:0;jenkins-hbase4:41753] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-16 18:01:59,478 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-16 18:01:59,478 DEBUG [M:0;jenkins-hbase4:41753] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-16 18:01:59,478 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676570514498] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676570514498,5,FailOnTimeoutGroup] 2023-02-16 18:01:59,478 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676570514498] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676570514498,5,FailOnTimeoutGroup] 2023-02-16 18:01:59,478 INFO [M:0;jenkins-hbase4:41753] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-16 18:01:59,480 INFO [M:0;jenkins-hbase4:41753] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-16 18:01:59,480 INFO [M:0;jenkins-hbase4:41753] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-16 18:01:59,480 DEBUG [M:0;jenkins-hbase4:41753] master.HMaster(1512): Stopping service threads 2023-02-16 18:01:59,480 INFO [M:0;jenkins-hbase4:41753] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-16 18:01:59,480 ERROR [M:0;jenkins-hbase4:41753] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-16 18:01:59,481 INFO [M:0;jenkins-hbase4:41753] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-16 18:01:59,481 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-16 18:01:59,481 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-16 18:01:59,481 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 18:01:59,481 DEBUG [M:0;jenkins-hbase4:41753] zookeeper.ZKUtil(398): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-16 18:01:59,481 WARN [M:0;jenkins-hbase4:41753] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-16 18:01:59,481 INFO [M:0;jenkins-hbase4:41753] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-16 18:01:59,481 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 18:01:59,482 INFO [M:0;jenkins-hbase4:41753] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-16 18:01:59,482 DEBUG [M:0;jenkins-hbase4:41753] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 18:01:59,482 INFO [M:0;jenkins-hbase4:41753] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:59,482 DEBUG [M:0;jenkins-hbase4:41753] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:59,482 DEBUG [M:0;jenkins-hbase4:41753] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 18:01:59,482 DEBUG [M:0;jenkins-hbase4:41753] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:59,482 INFO [M:0;jenkins-hbase4:41753] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.71 KB heapSize=65.67 KB 2023-02-16 18:01:59,498 INFO [M:0;jenkins-hbase4:41753] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.71 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7c3b70a891354776bd9faf12e910faae 2023-02-16 18:01:59,502 DEBUG [M:0;jenkins-hbase4:41753] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7c3b70a891354776bd9faf12e910faae as hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7c3b70a891354776bd9faf12e910faae 2023-02-16 18:01:59,506 INFO [M:0;jenkins-hbase4:41753] regionserver.HStore(1080): Added hdfs://localhost:43359/user/jenkins/test-data/b91618c2-8df3-fc84-2c70-f878a84cf891/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7c3b70a891354776bd9faf12e910faae, entries=17, sequenceid=132, filesize=8.6 K 2023-02-16 18:01:59,507 INFO [M:0;jenkins-hbase4:41753] regionserver.HRegion(2947): Finished flush of dataSize ~54.71 KB/56026, heapSize ~65.66 KB/67232, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 25ms, sequenceid=132, compaction requested=false 2023-02-16 18:01:59,508 INFO [M:0;jenkins-hbase4:41753] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 18:01:59,508 DEBUG [M:0;jenkins-hbase4:41753] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 18:01:59,511 INFO [M:0;jenkins-hbase4:41753] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-16 18:01:59,511 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 18:01:59,511 INFO [M:0;jenkins-hbase4:41753] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41753 2023-02-16 18:01:59,512 DEBUG [M:0;jenkins-hbase4:41753] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,41753,1676570514302 already deleted, retry=false 2023-02-16 18:01:59,651 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:59,651 INFO [M:0;jenkins-hbase4:41753] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41753,1676570514302; zookeeper connection closed. 2023-02-16 18:01:59,651 ERROR [Listener at localhost/33589-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4af6234f rejected from java.util.concurrent.ThreadPoolExecutor@4ec9bec9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:59,652 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): master:41753-0x1005e4bbd1f0000, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:59,652 ERROR [Listener at localhost/33589-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@419db9a9 rejected from java.util.concurrent.ThreadPoolExecutor@4ec9bec9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:59,751 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): regionserver:42067-0x1005e4bbd1f0002, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:59,751 INFO [RS:1;jenkins-hbase4:42067] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42067,1676570514371; zookeeper connection closed. 2023-02-16 18:01:59,751 ERROR [Listener at localhost/33589-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@57c99cad rejected from java.util.concurrent.ThreadPoolExecutor@2b9b6a33[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:59,752 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): regionserver:42067-0x1005e4bbd1f0002, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:59,752 ERROR [Listener at localhost/33589-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2f87ca6e rejected from java.util.concurrent.ThreadPoolExecutor@2b9b6a33[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:59,752 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4f891ee] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4f891ee 2023-02-16 18:01:59,851 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): regionserver:44231-0x1005e4bbd1f0001, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:59,852 INFO [RS:0;jenkins-hbase4:44231] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44231,1676570514346; zookeeper connection closed. 2023-02-16 18:01:59,852 ERROR [Listener at localhost/33589-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7b025a18 rejected from java.util.concurrent.ThreadPoolExecutor@7f3dd1a0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:59,852 DEBUG [Listener at localhost/33589-EventThread] zookeeper.ZKWatcher(600): regionserver:44231-0x1005e4bbd1f0001, quorum=127.0.0.1:59223, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 18:01:59,852 ERROR [Listener at localhost/33589-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@62f47e8e rejected from java.util.concurrent.ThreadPoolExecutor@7f3dd1a0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 18:01:59,852 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5d702eff] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5d702eff 2023-02-16 18:01:59,852 INFO [Listener at localhost/33589] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-16 18:01:59,852 WARN [Listener at localhost/33589] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 18:01:59,856 INFO [Listener at localhost/33589] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 18:01:59,959 WARN [BP-782553877-172.31.14.131-1676570513702 heartbeating to localhost/127.0.0.1:43359] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 18:01:59,959 WARN [BP-782553877-172.31.14.131-1676570513702 heartbeating to localhost/127.0.0.1:43359] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-782553877-172.31.14.131-1676570513702 (Datanode Uuid 3e96bb74-0033-4b7f-b394-95ab73fc3cf3) service to localhost/127.0.0.1:43359 2023-02-16 18:01:59,960 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/944328f3-acc6-4077-0b2f-eb3e984b25b3/cluster_2f19ce4a-4bf5-c028-f8c0-e734d9205edb/dfs/data/data3/current/BP-782553877-172.31.14.131-1676570513702] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 18:01:59,960 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/944328f3-acc6-4077-0b2f-eb3e984b25b3/cluster_2f19ce4a-4bf5-c028-f8c0-e734d9205edb/dfs/data/data4/current/BP-782553877-172.31.14.131-1676570513702] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 18:01:59,961 WARN [Listener at localhost/33589] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 18:01:59,964 INFO [Listener at localhost/33589] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 18:02:00,069 WARN [BP-782553877-172.31.14.131-1676570513702 heartbeating to localhost/127.0.0.1:43359] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 18:02:00,069 WARN [BP-782553877-172.31.14.131-1676570513702 heartbeating to localhost/127.0.0.1:43359] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-782553877-172.31.14.131-1676570513702 (Datanode Uuid 1b63840c-8284-48cf-8d99-810330b36b57) service to localhost/127.0.0.1:43359 2023-02-16 18:02:00,069 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/944328f3-acc6-4077-0b2f-eb3e984b25b3/cluster_2f19ce4a-4bf5-c028-f8c0-e734d9205edb/dfs/data/data1/current/BP-782553877-172.31.14.131-1676570513702] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 18:02:00,070 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/944328f3-acc6-4077-0b2f-eb3e984b25b3/cluster_2f19ce4a-4bf5-c028-f8c0-e734d9205edb/dfs/data/data2/current/BP-782553877-172.31.14.131-1676570513702] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 18:02:00,079 INFO [Listener at localhost/33589] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 18:02:00,195 INFO [Listener at localhost/33589] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-16 18:02:00,210 INFO [Listener at localhost/33589] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-16 18:02:00,222 INFO [Listener at localhost/33589] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=291 (was 270) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost:43359 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:43359 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1124632911) connection to localhost/127.0.0.1:43359 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost:43359 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,41753,1676570514302)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1124632911) connection to localhost/127.0.0.1:43359 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1124632911) connection to localhost/127.0.0.1:43359 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/33589 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1124632911) connection to localhost/127.0.0.1:43359 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=597 (was 564) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=264 (was 261) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 170), AvailableMemoryMB=2142 (was 1005) - AvailableMemoryMB LEAK? -